Wed May 2 04:16:26 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 04:16:29,630 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 04:16:29,635 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 04:16:29,635 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 04:16:29,635 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 04:16:29,636 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 04:16:30,358 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 04:16:30,358 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 04:16:30,367 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 04:16:30,367 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:16:30,372 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 04:16:30,372 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 04:16:30,372 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 04:16:30,372 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:16:30,372 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 04:16:30,372 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 04:16:30,372 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 04:16:30,373 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:16:30,373 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 04:16:30,374 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 04:16:30,374 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 04:16:30,374 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 04:16:30,374 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 04:16:30,375 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 04:16:30,375 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 04:16:30,375 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 04:16:30,375 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 04:16:30,376 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 04:16:30,376 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:16:30,376 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 04:16:30,376 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 04:16:30,377 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 04:16:30,377 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 04:16:30,377 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020416 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 04:16:30,379 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 04:16:30,379 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 04:16:30,379 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 04:16:30,379 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 04:16:30,379 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 04:16:30,379 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:16:30,380 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 04:16:30,381 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 04:16:30,383 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:16:30,385 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020416 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 04:16:30,386 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 04:16:30,400 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 04:16:30,401 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020416, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 04:16:31,641 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 04:16:31,733 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:16:32,540 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:16:32,547 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:16:32,852 INFO [main] timeline.HadoopTimelineMetricsSink: No suitable collector found. 2018-05-02 04:16:32,883 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:16:33,258 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:16:33,258 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:16:33,328 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 04:16:34,062 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 04:16:34,128 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:34,142 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 04:16:34,142 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 04:16:34,142 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 04:16:34,143 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:34,143 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:34,445 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 04:16:34,776 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 04:16:35,099 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 04:16:35,459 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 04:16:35,465 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=819.20 MB, blockSize=64 KB 2018-05-02 04:16:35,525 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:16:35,533 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:16:38,726 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:16:38,742 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:16:39,244 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:16:39,266 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 04:16:39,267 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:16:39,267 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 04:16:39,267 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 04:16:39,267 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 04:16:39,267 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 04:16:39,268 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 04:16:39,269 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@ad3324b 2018-05-02 04:16:39,315 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 04:16:39,317 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 04:16:39,323 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:16:39,333 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:16:39,344 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 04:16:39,354 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 04:16:39 UTC 2018 2018-05-02 04:16:39,355 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 04:16:39 UTC 2018 2018-05-02 04:16:39,355 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Wed May 02 23:44:18 UTC 2018 2018-05-02 04:16:39,359 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790010, negotiated timeout = 90000 2018-05-02 04:16:39,558 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460 2018-05-02 04:16:39,959 INFO [main] util.log: Logging initialized @12087ms 2018-05-02 04:16:40,189 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 04:16:40,253 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 04:16:40,254 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 04:16:40,257 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 04:16:40,260 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 04:16:40,260 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 04:16:40,325 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 04:16:40,327 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 04:16:40,417 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@66273da0{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 04:16:40,417 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@1229a2b7{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 04:16:40,708 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@57272109{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:16:40,726 INFO [main] ssl.SslContextFactory: x509=X509@5f69e2b(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@984169e(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 04:16:40,749 INFO [main] server.AbstractConnector: Started ServerConnector@2cc75074{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:16:40,750 INFO [main] server.Server: Started @12878ms 2018-05-02 04:17:53,264 INFO [timeline] timeline.HadoopTimelineMetricsSink: No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times. 2018-05-02 04:17:55,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 5e3858a0-79df-4411-900f-33628cd0efb1 2018-05-02 04:17:55,643 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x743fd979 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 04:17:55,656 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x743fd979] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$47/403460771@5d0ecfc6 2018-05-02 04:17:55,658 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x743fd979-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:17:55,660 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x743fd979-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:17:55,660 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x743fd979-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 04:17:55,664 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x743fd979-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790014, negotiated timeout = 90000 2018-05-02 04:17:55,761 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 04:17:55,761 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 04:17:55,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 04:17:55,785 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,785 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 04:17:55,785 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 04:17:55,785 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 04:17:55,785 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 04:17:55,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 04:17:55,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 04:17:55,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 04:17:56,125 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 04:17:56,132 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 04:17:56,133 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 04:17:56,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 04:17:56,139 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 04:17:56,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 04:17:56,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 04:17:56,202 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 04:17:56,227 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 04:17:56,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 04:17:56,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 04:17:56,229 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 04:17:56,229 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 04:17:56,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 04:17:56,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:17:56,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 04:17:56,250 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:17:56,250 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 04:17:56,250 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 04:17:56,251 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:17:56,327 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 04:17:56,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 04:17:56,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 04:17:56,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 04:17:56,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 04:17:56,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 04:17:56,393 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 04:17:56,393 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 04:17:56,393 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 04:17:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 04:17:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 04:17:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 04:17:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 04:17:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 04:17:56,395 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 04:17:56,395 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 04:17:56,395 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 04:17:56,396 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 04:17:56,396 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 04:17:56,398 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,398 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,398 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 04:17:56,398 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 04:17:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 04:17:56,401 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 04:17:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 04:17:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 04:17:56,404 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 04:17:56,404 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 04:17:56,405 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 04:17:56,409 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:17:56,412 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:17:56,412 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 04:17:56,683 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:17:57,188 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:17:59,968 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=2 2018-05-02 04:18:00,347 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:00,347 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:00,351 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:00,354 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 04:18:00,357 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 04:18:00,402 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525234664535 with port=16020, startcode=1525234590460 2018-05-02 04:18:00,911 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:18:01,411 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 04:18:01,488 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=778.2 M, Offheap=false 2018-05-02 04:18:01,504 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 04:18:01,508 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 04:18:01,537 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 04:18:01,670 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460 starting 2018-05-02 04:18:01,679 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 04:18:01,693 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 04:18:01,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 04:18:01,725 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525234558441] other RSs: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525234558441] 2018-05-02 04:18:01,817 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x3631f08b2790010 2018-05-02 04:18:01,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 04:18:01,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 04:18:03,312 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 04:18:04,953 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525234590460, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:18:05,683 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 577 ms, current pipeline: [] 2018-05-02 04:18:05,684 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525234590460.1525234684954 2018-05-02 04:18:55,691 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x743fd979] zookeeper.ZooKeeper: Session: 0x3631f08b2790014 closed 2018-05-02 04:18:55,691 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x743fd979-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 04:20:13,383 INFO [timeline] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:21:35,520 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 04:23:38,794 INFO [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525234712010.0b19753c89c8b3102c90fe9143d5e4a4. 2018-05-02 04:23:39,172 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 04:23:39,196 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 04:23:39,196 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 04:23:39,196 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 04:23:39,198 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 04:23:39,198 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 04:23:39,404 INFO [StoreOpener-0b19753c89c8b3102c90fe9143d5e4a4-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:23:39,418 INFO [StoreOpener-0b19753c89c8b3102c90fe9143d5e4a4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:23:39,612 INFO [StoreOpener-0b19753c89c8b3102c90fe9143d5e4a4-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:23:39,739 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 0b19753c89c8b3102c90fe9143d5e4a4; next sequenceid=10 2018-05-02 04:23:39,836 INFO [PostOpenDeployTasks:0b19753c89c8b3102c90fe9143d5e4a4] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525234712010.0b19753c89c8b3102c90fe9143d5e4a4. 2018-05-02 04:23:43,311 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 04:23:43,312 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 04:23:43,312 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 04:23:44,261 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:23:44,265 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:23:44,266 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:23:44,775 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:23:45,249 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:23:45,249 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:23:45,367 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:23:45,367 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:23:45,367 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:23:45,377 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:23:45,381 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:23:45,381 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:24:01,423 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=2; newVersion=4 2018-05-02 04:24:01,435 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:24:01,435 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:24:01,435 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:26:35,520 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 04:28:44,259 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:28:44,261 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:28:44,265 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:28:44,773 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:28:45,238 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:28:45,238 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:28:45,381 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:28:45,381 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:28:45,382 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:28:45,391 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:28:45,397 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:28:45,397 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:30:02,204 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=4; newVersion=6 2018-05-02 04:30:02,211 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:30:02,211 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:30:02,211 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:31:35,520 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 04:33:02,799 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=6; newVersion=10 2018-05-02 04:33:02,805 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:33:02,805 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:33:02,805 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:33:44,259 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:33:44,266 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:33:44,269 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:33:44,776 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:33:45,064 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:33:45,064 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:33:45,138 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:33:45,138 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:33:45,138 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:33:45,143 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:33:45,145 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:33:45,145 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:35:33,012 ERROR [Thread-24] client.RangerAdminRESTClient: Error getting policies for serviceName=cl1_hbaseresponse=null com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) at com.sun.jersey.api.client.Client.handle(Client.java:652) at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:120) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:171) Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:673) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.protocol.https.HttpsClient.(HttpsClient.java:264) at sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:367) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:191) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:177) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:347) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ... 13 more 2018-05-02 04:36:33,049 ERROR [Thread-24] client.RangerAdminRESTClient: Error getting policies for serviceName=cl1_hbaseresponse=null com.sun.jersey.api.client.ClientHandlerException: java.net.SocketTimeoutException: Read timed out at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) at com.sun.jersey.api.client.Client.handle(Client.java:652) at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:120) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:171) Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:171) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983) at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1385) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1413) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1397) at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:559) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:347) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ... 13 more 2018-05-02 04:36:35,523 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 04:38:44,259 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:38:44,261 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:38:44,264 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:38:44,769 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:38:44,980 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:38:44,981 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:38:45,217 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:38:45,217 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:38:45,217 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:38:45,225 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:38:45,228 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:38:45,228 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:40:33,775 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=10; newVersion=11 2018-05-02 04:40:33,779 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:40:33,779 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:40:33,780 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:41:35,520 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=149, evicted=0, evictedPerRun=0.0 2018-05-02 04:43:44,260 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:43:44,262 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:43:44,266 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:43:44,772 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:43:45,053 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:43:45,054 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:43:45,133 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:43:45,133 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:43:45,133 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:43:45,138 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:43:45,139 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:43:45,140 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:46:35,520 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=179, evicted=0, evictedPerRun=0.0 2018-05-02 04:47:34,737 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=11; newVersion=13 2018-05-02 04:47:34,754 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=44; leafNodeCount=3; singleChildNodeCount=40; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=2; evaluatorListRefCount=42; wildcardEvaluatorListRefCount=42 2018-05-02 04:47:34,759 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:47:34,759 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:48:44,259 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:48:44,261 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:48:44,264 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:48:44,772 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:48:45,089 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:48:45,090 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:48:45,183 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:48:45,183 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:48:45,183 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:48:45,192 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:48:45,194 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:48:45,194 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:51:35,520 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=209, evicted=0, evictedPerRun=0.0 2018-05-02 04:53:44,260 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:53:44,261 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:53:44,264 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:53:44,770 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:53:45,000 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:53:45,001 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:53:45,089 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:53:45,090 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:53:45,090 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:53:45,098 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:53:45,102 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:53:45,102 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:55:35,625 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=13; newVersion=14 2018-05-02 04:55:35,631 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 04:55:35,631 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:55:35,631 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 Wed May 2 04:56:14 UTC 2018 Terminating regionserver 2018-05-02 04:56:14,218 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 04:56:14,218 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 04:56:14,218 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 04:56:14,218 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 04:56:14,219 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 04:56:14,219 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 04:56:14,219 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 04:56:14,219 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,219 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,220 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,220 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 04:56:14,220 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,220 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,220 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,220 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,220 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,220 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,221 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 3 milli seconds 2018-05-02 04:56:14,221 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 04:56:14,221 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 04:56:14,221 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:56:14,222 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@3c46dcbe 2018-05-02 04:56:14,222 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460' ***** 2018-05-02 04:56:14,237 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,255 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 04:56:14,255 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 04:56:14,255 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 04:56:14,256 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 04:56:14,256 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460 exiting 2018-05-02 04:56:14,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@57272109{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:56:14,276 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@2cc75074{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:56:14,277 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@1229a2b7{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 04:56:14,277 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@66273da0{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 04:56:14,279 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 04:56:14,279 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 04:56:14,279 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 04:56:14,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 04:56:14,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 04:56:14,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,282 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460 2018-05-02 04:56:14,282 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x743fd979 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:56:14,282 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 1 regions to close 2018-05-02 04:56:14,283 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,406 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed hbase:namespace,,1525234712010.0b19753c89c8b3102c90fe9143d5e4a4. 2018-05-02 04:56:14,483 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460; all regions closed. 2018-05-02 04:56:14,546 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525234590460:(num 1525234684954) 2018-05-02 04:56:14,547 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 04:56:14,548 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 04:56:14,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 04:56:14,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 04:56:14,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 04:56:14,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 04:56:14,556 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 04:56:14,556 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 04:56:14,617 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 04:56:14,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x3631f08b2790010 closed 2018-05-02 04:56:14,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460; zookeeper connection closed. 2018-05-02 04:56:14,618 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 04:56:14,622 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 04:57:47 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 04:57:49,836 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 04:57:49,839 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 04:57:49,840 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 04:57:49,840 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 04:57:49,840 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 04:57:50,335 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 04:57:50,336 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 04:57:50,336 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 04:57:50,336 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:57:50,338 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 04:57:50,338 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 04:57:50,338 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 04:57:50,338 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:57:50,338 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 04:57:50,338 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 04:57:50,339 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 04:57:50,340 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020457 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 04:57:50,341 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 04:57:50,341 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 04:57:50,341 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 04:57:50,341 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 04:57:50,341 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 04:57:50,341 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 04:57:50,342 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:57:50,343 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 04:57:50,343 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 04:57:50,344 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:57:50,345 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020457 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 04:57:50,346 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 04:57:50,349 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 04:57:50,350 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020457, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 04:57:50,973 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 04:57:51,023 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:57:51,523 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:57:51,530 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:57:52,040 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:57:52,041 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:57:52,041 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:57:52,113 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:57:52,293 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:57:52,293 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:57:52,328 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 04:57:52,590 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 04:57:52,607 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:57:52,609 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 04:57:52,610 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 04:57:52,610 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 04:57:52,610 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:57:52,610 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:57:52,746 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 04:57:52,929 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 04:57:53,043 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 04:57:53,145 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 04:57:53,149 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=819.20 MB, blockSize=64 KB 2018-05-02 04:57:53,157 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:57:53,158 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:57:54,706 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:57:54,720 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:57:54,800 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:57:54,812 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 04:57:54,812 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:57:54,812 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 04:57:54,812 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 04:57:54,812 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 04:57:54,813 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 04:57:54,826 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 04:57:54,828 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 04:57:54,871 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 04:57:54,873 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 04:57:54,880 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:57:54,884 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 04:57:54 UTC 2018 2018-05-02 04:57:54,884 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 04:57:54 UTC 2018 2018-05-02 04:57:54,884 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:05:56 UTC 2018 2018-05-02 04:57:54,889 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:57:54,896 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 04:57:54,904 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790049, negotiated timeout = 90000 2018-05-02 04:57:55,042 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398 2018-05-02 04:57:55,219 INFO [main] util.log: Logging initialized @6488ms 2018-05-02 04:57:55,339 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 04:57:55,355 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 04:57:55,355 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 04:57:55,358 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 04:57:55,358 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 04:57:55,359 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 04:57:55,406 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 04:57:55,408 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 04:57:55,481 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 04:57:55,482 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 04:57:55,691 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:57:55,697 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 04:57:55,713 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:57:55,713 INFO [main] server.Server: Started @6983ms 2018-05-02 04:57:55,743 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 04:57:55,810 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x7a0d321b to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 04:57:55,822 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/982320166@7f8f9d13 2018-05-02 04:57:55,824 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:57:55,826 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:57:55,826 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 04:57:55,832 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390041, negotiated timeout = 90000 2018-05-02 04:57:55,936 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 04:57:55,936 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 04:57:55,959 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 04:57:55,959 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:55,959 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 04:57:55,959 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 04:57:55,960 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 04:57:55,960 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 04:57:55,960 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:55,960 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 04:57:55,960 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:55,960 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 04:57:55,960 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:55,961 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 04:57:56,208 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 04:57:56,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 04:57:56,215 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 04:57:56,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 04:57:56,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:57:56,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 04:57:56,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 04:57:56,282 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 04:57:56,294 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 04:57:56,295 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 04:57:56,295 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:56,295 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 04:57:56,295 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 04:57:56,295 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 04:57:56,296 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 04:57:56,296 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:57:56,296 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 04:57:56,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:57:56,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 04:57:56,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 04:57:56,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:57:56,360 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 04:57:56,392 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 04:57:56,393 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 04:57:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:57:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 04:57:56,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 04:57:56,395 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 04:57:56,400 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 04:57:56,401 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 04:57:56,401 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 04:57:56,401 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 04:57:56,401 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 04:57:56,402 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:57:56,402 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:56,402 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 04:57:56,402 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 04:57:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 04:57:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 04:57:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:57:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:56,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 04:57:56,404 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 04:57:56,404 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 04:57:56,404 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 04:57:56,404 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 04:57:56,409 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:57:56,415 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 04:57:56,417 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:57:56,616 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:57:57,017 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:57:59,590 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=14 2018-05-02 04:57:59,719 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 04:57:59,720 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:57:59,720 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:57:59,721 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 04:57:59,722 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 04:57:59,750 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237056151 with port=16020, startcode=1525237070398 2018-05-02 04:58:00,050 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:58:00,289 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 04:58:00,324 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=778.2 M, Offheap=false 2018-05-02 04:58:00,333 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 04:58:00,336 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 04:58:00,354 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 04:58:00,508 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398 starting 2018-05-02 04:58:00,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 04:58:00,519 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 04:58:00,520 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 04:58:00,524 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928] other RSs: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928] 2018-05-02 04:58:00,557 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x3631f08b2790049 2018-05-02 04:58:00,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 04:58:00,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 04:58:02,321 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 04:58:03,642 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237070398, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:58:04,053 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 293 ms, current pipeline: [] 2018-05-02 04:58:04,054 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237070398.1525237083643 2018-05-02 04:58:23,000 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 04:58:23,272 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 04:58:23,277 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 04:58:23,277 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 04:58:23,277 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 04:58:23,278 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 04:58:23,278 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 04:58:23,484 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:58:23,502 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:58:23,578 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:58:23,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=2 2018-05-02 04:58:23,795 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 04:58:26,442 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@629771a2 2018-05-02 04:58:26,445 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:58:26,446 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:58:26,447 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 04:58:26,451 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b279004d, negotiated timeout = 10000 2018-05-02 04:58:26,494 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 04:58:26,502 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 04:58:28,312 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:58:28,314 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:58:28,317 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:58:28,823 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:58:29,097 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:58:29,097 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 04:58:29,191 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 04:58:29,191 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:58:29,191 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:58:29,198 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:58:29,201 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:58:29,201 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:58:32,314 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 04:58:32,315 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 04:58:32,316 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 04:58:55,872 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b] zookeeper.ZooKeeper: Session: 0x2631f08d9390041 closed 2018-05-02 04:58:55,872 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 04:58:56,417 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.023 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 05:01:00,171 INFO [Thread-22] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=14; newVersion=18 2018-05-02 05:01:00,184 INFO [Thread-22] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:01:00,185 INFO [Thread-22] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:01:00,185 INFO [Thread-22] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:02:33,936 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:02:33,940 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 1 failover attempts. Trying to failover after sleeping for 1281ms. 2018-05-02 05:02:35,223 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 2 failover attempts. Trying to failover after sleeping for 1596ms. 2018-05-02 05:02:36,822 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 3 failover attempts. Trying to failover after sleeping for 3859ms. 2018-05-02 05:02:40,684 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 4 failover attempts. Trying to failover after sleeping for 9335ms. 2018-05-02 05:02:50,021 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 5 failover attempts. Trying to failover after sleeping for 20469ms. 2018-05-02 05:02:53,159 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:03:10,494 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 6 failover attempts. Trying to failover after sleeping for 20657ms. 2018-05-02 05:03:28,312 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:03:28,314 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:03:28,318 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:03:28,828 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:03:29,163 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:03:29,164 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:03:29,242 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:03:29,242 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:03:29,243 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:03:29,250 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:03:29,253 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:03:29,253 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:03:30,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. because info has an old edit so flush to free WALs after random delay 69370ms 2018-05-02 05:03:31,154 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 7 failover attempts. Trying to failover after sleeping for 21307ms. 2018-05-02 05:03:40,448 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. because info has an old edit so flush to free WALs after random delay 230399ms 2018-05-02 05:03:51,358 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. because info has an old edit so flush to free WALs after random delay 99657ms 2018-05-02 05:03:52,486 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Retrying after sleeping for 20293ms. 2018-05-02 05:04:00,517 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. because info has an old edit so flush to free WALs after random delay 33404ms 2018-05-02 05:04:10,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. because info has an old edit so flush to free WALs after random delay 21930ms 2018-05-02 05:04:12,785 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Retrying after sleeping for 8694ms. 2018-05-02 05:04:20,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. because info has an old edit so flush to free WALs after random delay 207843ms 2018-05-02 05:04:21,489 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Retrying after sleeping for 15210ms. 2018-05-02 05:04:30,448 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. because info has an old edit so flush to free WALs after random delay 61363ms 2018-05-02 05:04:36,704 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Retrying after sleeping for 10547ms. 2018-05-02 05:04:39,986 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:04:40,000 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=78 B memstore heap size=232 B 2018-05-02 05:04:40,049 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Retrying immediately. 2018-05-02 05:04:40,053 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Retrying after sleeping for 931ms. 2018-05-02 05:04:40,990 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Retrying after sleeping for 2632ms. 2018-05-02 05:04:41,444 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=06:45.150 minutes, events=1, succcessCount=1, totalEvents=1, totalSuccessCount=1 2018-05-02 05:04:43,628 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Retrying after sleeping for 2674ms. 2018-05-02 05:04:46,311 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Retrying after sleeping for 6937ms. 2018-05-02 05:04:47,257 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Retrying after sleeping for 19013ms. 2018-05-02 05:04:53,254 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Retrying after sleeping for 13301ms. 2018-05-02 05:04:56,445 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=2, succcessCount=1, totalEvents=4, totalSuccessCount=2 2018-05-02 05:05:06,274 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 191 has reached the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-268900369_1. Name node is in safe mode. The reported blocks 191 has reached the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Retrying after sleeping for 16553ms. 2018-05-02 05:05:06,563 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 191 has reached the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 0 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info. Name node is in safe mode. The reported blocks 191 has reached the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 0 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Retrying after sleeping for 13513ms. 2018-05-02 05:05:20,298 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/.tmp/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 05:05:20,561 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f, entries=2, sequenceid=6, filesize=4.8 K 2018-05-02 05:05:20,588 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~78 B/78, heap size ~448 B/448, currentsize=0 B/0 for 60955ebb25dcf0aeb6d46e894a921538 in 40588ms, sequenceid=6, compaction requested=false 2018-05-02 05:07:53,156 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 Wed May 2 05:08:16 UTC 2018 Terminating regionserver 2018-05-02 05:08:16,948 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:08:16,948 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:08:16,948 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:08:16,949 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:08:16,949 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:08:16,949 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:08:16,949 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:08:16,949 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:08:16,949 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 05:08:16,949 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:08:16,950 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:16,950 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:08:16,950 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:08:16,950 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:08:16,950 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:08:16,950 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:08:16,950 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:08:16,950 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:08:16,950 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:16,951 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:08:16,951 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:08:16,951 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:08:16,951 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398' ***** 2018-05-02 05:08:16,951 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:08:16,951 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:16,951 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:08:16,951 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:16,952 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:16,952 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:16,952 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:16,952 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=03:35.508 minutes, events=1, succcessCount=1, totalEvents=2, totalSuccessCount=2 2018-05-02 05:08:16,953 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:16,953 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:08:16,953 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:16,954 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:08:16,955 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:08:16,955 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:08:16,956 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:08:16,956 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398 exiting 2018-05-02 05:08:16,971 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:08:16,979 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:08:16,980 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:08:16,980 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:08:16,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:08:16,984 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:08:16,984 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:08:16,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:08:16,985 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:08:16,985 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:16,989 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398 2018-05-02 05:08:16,989 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x7a0d321b to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:08:16,989 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 1 regions to close 2018-05-02 05:08:16,989 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:17,070 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:08:17,189 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398; all regions closed. 2018-05-02 05:08:17,340 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237070398:(num 1525237083643) 2018-05-02 05:08:17,342 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 05:08:17,342 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:08:17,343 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:08:17,343 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:08:17,343 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:08:17,343 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:08:17,357 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 05:08:17,357 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:08:17,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x3631f08b2790049 closed 2018-05-02 05:08:17,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398; zookeeper connection closed. 2018-05-02 05:08:17,553 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:08:17,554 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:08:17,555 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:09:34 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:09:39,147 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:09:39,166 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:09:39,166 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:09:39,166 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:09:39,166 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:09:40,080 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:09:40,080 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:09:40,080 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:09:40,080 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:09:40,082 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:09:40,083 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020509 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:09:40,084 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:09:40,085 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:09:40,085 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:09:40,085 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:09:40,085 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:09:40,085 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:09:40,086 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020509 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:09:40,087 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:09:40,090 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:09:40,090 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020509, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:09:40,321 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:09:40,840 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:09:40,960 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:09:42,012 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:09:42,024 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:09:42,617 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:09:42,617 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:09:42,617 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:09:42,738 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:09:43,027 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:09:43,028 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:09:43,109 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:09:43,785 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 05:09:43,840 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:43,850 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:09:43,853 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:09:43,854 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:09:43,854 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:43,855 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:44,119 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:09:44,571 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:09:44,619 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:09:44,775 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 05:09:45,269 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:09:45,272 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:09:45,275 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:09:45,311 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:09:45,314 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:09:45,323 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:09:46,943 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:09:46,958 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:09:47,031 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:09:47,043 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:09:47,043 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:09:47,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:09:47,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:09:47,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:09:47,043 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:09:47,044 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:09:47,044 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:09:47,044 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:09:47,045 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:09:47,045 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:09:47,045 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 05:09:47,045 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:09:47,045 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:09:47,045 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:09:47,046 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:09:47,091 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:09:47,093 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:09:47,102 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:09:47,110 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:09:47,110 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:09:47 UTC 2018 2018-05-02 05:09:47,110 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:09:47 UTC 2018 2018-05-02 05:09:47,110 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 00:55:25 UTC 2018 2018-05-02 05:09:47,117 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:09:47,125 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790068, negotiated timeout = 90000 2018-05-02 05:09:47,128 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:09:47,129 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068 connected 2018-05-02 05:09:47,166 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:09:47,261 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:47,266 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:09:47,337 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:47,341 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:09:47,341 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:09:47,356 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:47,360 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:47,442 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:09:47,442 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:09:47,442 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:09:47,469 INFO [main] util.log: Logging initialized @10613ms 2018-05-02 05:09:47,546 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:09:47,561 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:09:47,561 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:09:47,564 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:09:47,564 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:09:47,564 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:09:47,602 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:09:47,605 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:09:47,671 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:09:47,671 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:09:47,964 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:09:47,972 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:09:47,991 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:09:47,991 INFO [main] server.Server: Started @11136ms 2018-05-02 05:09:48,021 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:09:48,027 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:09:48,046 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:09:48,046 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:09:48,051 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:09:48,083 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x374791e6 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:09:48,094 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x374791e6] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/329015645@569eed4a 2018-05-02 05:09:48,096 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x374791e6-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:09:48,098 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x374791e6-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:09:48,098 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x374791e6-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:09:48,102 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x374791e6-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390063, negotiated timeout = 90000 2018-05-02 05:09:48,148 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fe12026, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:09:48,151 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a5ddbe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:0 2018-05-02 05:09:48,157 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000008:16020 2018-05-02 05:09:48,170 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:09:48,170 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:09:48,190 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:09:48,190 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:48,190 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:09:48,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:48,192 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:09:48,440 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:09:48,443 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:09:48,449 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:09:48,450 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:09:48,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:09:48,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:09:48,515 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:09:48,515 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:09:48,515 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:09:48,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:09:48,517 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:09:48,517 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:09:48,517 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:09:48,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:09:48,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:09:48,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:48,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:09:48,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:09:48,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:09:48,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:09:48,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:09:48,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:09:48,543 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:09:48,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:09:48,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:09:48,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:09:48,606 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:09:48,649 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:09:48,650 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:09:48,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:48,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:48,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:09:48,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:09:48,653 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:09:48,660 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:09:48,660 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:09:48,660 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:09:48,660 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:09:48,661 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:09:48,661 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:09:48,661 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:09:48,661 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:09:48,661 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:09:48,662 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:09:48,662 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:09:48,662 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:09:48,662 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:09:48,664 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:48,664 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:48,664 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:09:48,664 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:09:48,664 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:09:48,665 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:09:48,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:48,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:48,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:09:48,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:09:48,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:09:48,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:09:48,667 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:09:48,672 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:09:48,675 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:09:48,676 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:09:48,907 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:09:49,289 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:09:52,006 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:09:52,150 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:09:52,150 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:09:52,151 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:09:52,151 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:09:52,152 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:09:52,201 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237764081 with port=16020, startcode=1525237780134 2018-05-02 05:09:52,292 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:09:52,292 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:09:52,294 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:09:52,401 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:09:52,418 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:09:52,461 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:09:52,464 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:09:52,468 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:09:52,469 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:09:52,470 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:09:52,527 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:09:52,528 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:09:52,528 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:09:52,571 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:09:52,585 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:09:52,879 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:09:52,918 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:09:52,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:09:52,998 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:09:53,002 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:09:53,021 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:09:53,099 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:09:53,100 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:09:53,109 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:09:53,109 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:09:53,109 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:09:53,110 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:09:53,110 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:09:53,110 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:09:53,110 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:09:53,113 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:09:53,219 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 starting 2018-05-02 05:09:53,220 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:09:53,224 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:09:53,232 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:09:53,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:09:53,244 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:09:53,250 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237076568, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134] other RSs: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134] 2018-05-02 05:09:53,291 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x3631f08b2790068 2018-05-02 05:09:53,291 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:09:53,291 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:09:53,291 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134' 2018-05-02 05:09:53,291 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:09:53,292 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:09:53,293 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:09:53,293 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:09:53,293 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:09:53,293 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134' 2018-05-02 05:09:53,293 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:09:53,294 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:09:53,295 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:09:53,295 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:09:53,295 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:09:54,005 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:09:54,007 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:09:54,010 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:09:54,013 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:54,013 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:09:54,013 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/1 2018-05-02 05:09:54,014 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:54,301 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:09:56,361 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237780134, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:09:56,702 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 232 ms, current pipeline: [] 2018-05-02 05:09:56,703 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237780134.1525237796361 2018-05-02 05:09:56,703 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:10:03,591 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:10:05,733 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:10:05,739 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:10:05,739 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:05,748 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:10:05,761 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:05,761 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:10:05,763 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:05,764 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:10:05,765 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:10:05,887 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 17 service: ClientService methodName: Get size: 117 connection: 172.27.59.154:59540 deadline: 1525237895829, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:10:06,083 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 20 service: ClientService methodName: Get size: 117 connection: 172.27.59.154:59540 deadline: 1525237896082, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:10:06,314 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 27 service: ClientService methodName: Get size: 117 connection: 172.27.59.154:59540 deadline: 1525237896313, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:10:06,639 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 33 service: ClientService methodName: Get size: 117 connection: 172.27.59.154:59540 deadline: 1525237896638, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:10:07,165 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 36 service: ClientService methodName: Get size: 117 connection: 172.27.59.154:59540 deadline: 1525237897164, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:10:08,191 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 40 service: ClientService methodName: Get size: 117 connection: 172.27.59.154:59540 deadline: 1525237898189, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:10:10,217 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 46 service: ClientService methodName: Get size: 117 connection: 172.27.59.154:59540 deadline: 1525237900217, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:10:48,128 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x374791e6] zookeeper.ZooKeeper: Session: 0x2631f08d9390063 closed 2018-05-02 05:10:48,128 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x374791e6-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:11:09,631 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:11:09,633 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:09,633 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,636 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:11:09,638 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,638 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:09,639 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,640 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:11:09,640 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:09,675 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:09,814 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:09,815 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:09,816 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:09,817 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:09,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 05:11:09,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 6cfc24cc3a423e0969138ce2a69be99e, NAME => 'test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 05:11:09,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 05:11:09,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:11:09,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => cb06832d0afac8a9bdbe1f92ad565ab6, NAME => 'test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 05:11:09,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 05:11:09,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AuthenticationService 2018-05-02 05:11:09,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AuthenticationService 2018-05-02 05:11:09,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 05:11:09,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 05:11:09,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=SecureBulkLoadService 2018-05-02 05:11:09,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 05:11:09,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=SecureBulkLoadService 2018-05-02 05:11:09,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AccessControlService 2018-05-02 05:11:09,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,943 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 05:11:09,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,943 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 05:11:09,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,944 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AccessControlService 2018-05-02 05:11:09,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,944 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 05:11:09,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,944 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,944 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 05:11:09,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 05:11:09,945 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,945 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,945 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,945 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,946 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,946 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,984 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:11:09,985 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 05:11:09,985 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 05:11:09,985 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:09,985 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:09,984 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 05:11:09,989 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:09,985 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:11:09,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:09,985 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:10,010 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,010 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,010 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,010 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,011 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,146 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:11:10,146 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:11:10,146 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 05:11:10,146 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 05:11:10,146 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:11:10,146 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 05:11:10,146 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 05:11:10,147 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 05:11:10,147 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:11:10,147 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 05:11:10,185 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,185 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,185 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,186 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,187 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,202 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,202 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,202 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,202 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,202 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,233 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,233 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,233 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,233 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,233 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,255 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:11:10,255 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 05:11:10,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:11:10,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 05:11:10,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 05:11:10,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,317 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=2 2018-05-02 05:11:10,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,318 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=2 2018-05-02 05:11:10,317 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened cb06832d0afac8a9bdbe1f92ad565ab6; next sequenceid=2 2018-05-02 05:11:10,317 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 6cfc24cc3a423e0969138ce2a69be99e; next sequenceid=2 2018-05-02 05:11:10,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,318 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=2 2018-05-02 05:11:10,397 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:10,412 INFO [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:10,413 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:10,414 INFO [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:10,414 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:10,434 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:10,434 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:10,435 DEBUG [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:10,435 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:10,435 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:10,436 DEBUG [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:10,436 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:10,436 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:10,436 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:10,436 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:10,989 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:11:13,056 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,056 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:11:13,057 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,057 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:11:13,058 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,058 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:11:13,253 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad." 2018-05-02 05:11:13,268 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close c963eb77dbdc6dbab886dbe4eebba5ad without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,271 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 05:11:13,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:13,274 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6." 2018-05-02 05:11:13,274 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close cb06832d0afac8a9bdbe1f92ad565ab6 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,275 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e." 2018-05-02 05:11:13,275 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 6cfc24cc3a423e0969138ce2a69be99e without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,275 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing cb06832d0afac8a9bdbe1f92ad565ab6, disabling compactions & flushes 2018-05-02 05:11:13,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:13,276 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a." 2018-05-02 05:11:13,276 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 2fd8c4d5abf9928da8e8c547a0ca223a without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,276 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 6cfc24cc3a423e0969138ce2a69be99e, disabling compactions & flushes 2018-05-02 05:11:13,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:13,277 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62." 2018-05-02 05:11:13,277 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 665f3f34ec072c60acee3dc78af73b62 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,310 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,319 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,320 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,320 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,321 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,321 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,321 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,323 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:13,321 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,324 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:13,328 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:13,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:13,329 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 05:11:13,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:13,332 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,332 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 2fd8c4d5abf9928da8e8c547a0ca223a, disabling compactions & flushes 2018-05-02 05:11:13,332 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:13,334 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,334 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,334 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,336 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:13,341 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:13,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,370 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,370 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,370 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,370 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:13,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:13,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,379 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:13,396 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:14,665 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:14,687 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:14,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 6cfc24cc3a423e0969138ce2a69be99e, NAME => 'test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 05:11:14,687 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:14,688 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AuthenticationService 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 05:11:14,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => cb06832d0afac8a9bdbe1f92ad565ab6, NAME => 'test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=SecureBulkLoadService 2018-05-02 05:11:14,688 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:14,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 05:11:14,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AccessControlService 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 05:11:14,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 05:11:14,689 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AuthenticationService 2018-05-02 05:11:14,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:11:14,689 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,689 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 05:11:14,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 05:11:14,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:14,690 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 05:11:14,690 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,690 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,690 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,690 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,689 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,689 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 05:11:14,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 05:11:14,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=SecureBulkLoadService 2018-05-02 05:11:14,691 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,691 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,691 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 05:11:14,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 05:11:14,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:11:14,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:14,691 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,691 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,691 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AccessControlService 2018-05-02 05:11:14,692 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 05:11:14,692 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:14,692 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,692 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,692 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,692 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 05:11:14,693 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,693 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:11:14,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:14,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 05:11:14,693 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:14,694 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,713 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 05:11:14,713 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 05:11:14,715 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,716 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,718 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:11:14,718 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:11:14,718 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:11:14,718 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:11:14,719 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 05:11:14,719 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 05:11:14,719 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,719 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,719 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 05:11:14,720 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 05:11:14,720 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,720 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,720 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,720 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,721 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,721 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,722 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,723 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,723 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,724 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,726 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:11:14,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 05:11:14,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 05:11:14,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 05:11:14,745 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:11:14,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,851 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 6cfc24cc3a423e0969138ce2a69be99e; next sequenceid=5 2018-05-02 05:11:14,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=5 2018-05-02 05:11:14,854 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=5 2018-05-02 05:11:14,855 INFO [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:14,856 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:14,857 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:14,861 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=5 2018-05-02 05:11:14,861 DEBUG [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:11:14,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:14,861 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened cb06832d0afac8a9bdbe1f92ad565ab6; next sequenceid=5 2018-05-02 05:11:14,863 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:11:14,864 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:11:14,864 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:14,864 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:14,864 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:14,866 INFO [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:14,868 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:11:14,869 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:14,869 DEBUG [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:11:14,870 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:11:14,985 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:11:14,987 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:11:14,989 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:11:15,500 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:11:15,708 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@50cc96b8 2018-05-02 05:11:15,710 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:11:15,712 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:11:15,712 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:11:15,716 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00ac, negotiated timeout = 10000 2018-05-02 05:11:15,742 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:11:15,747 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:11:15,760 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:11:15,760 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:11:15,847 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:11:15,847 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:11:15,847 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:11:15,856 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:11:15,859 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:11:15,859 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:11:16,003 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:11:16,005 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:16,005 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 635 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:16,008 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 107 from saslServer. 2018-05-02 05:11:16,012 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:16,013 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:16,030 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:16,030 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:11:16,031 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:18,393 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:11:18,395 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:18,395 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:18,398 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:11:18,407 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:18,407 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:18,410 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:18,410 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:11:18,410 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:47,358 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:11:47,362 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 113 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:11:48,682 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=348, succcessCount=142, totalEvents=348, totalSuccessCount=142 2018-05-02 05:11:56,559 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:12:01,339 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 145 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:01,341 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 146 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:02,319 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 160 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:02,319 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 161 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:02,319 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 160 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:02,321 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 162 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:15,689 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.009 minutes, events=257, succcessCount=257, totalEvents=257, totalSuccessCount=257 2018-05-02 05:12:48,682 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=882, succcessCount=276, totalEvents=1230, totalSuccessCount=418 2018-05-02 05:12:56,241 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 195 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:56,242 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 195 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:12:56,244 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 194 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:13:15,694 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=276, succcessCount=276, totalEvents=533, totalSuccessCount=533 2018-05-02 05:13:48,695 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.013 minutes, events=553, succcessCount=161, totalEvents=1783, totalSuccessCount=579 2018-05-02 05:13:56,770 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 05:13:56,772 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 522ms. 2018-05-02 05:13:57,299 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 2823ms. 2018-05-02 05:14:00,125 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 4645ms. 2018-05-02 05:14:04,773 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 10144ms. 2018-05-02 05:14:14,919 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 17050ms. 2018-05-02 05:14:31,971 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 17362ms. 2018-05-02 05:14:45,308 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:14:49,336 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 12224ms. 2018-05-02 05:14:53,245 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=7, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:14:53,245 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:15:01,562 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Trying to failover after sleeping for 20733ms. 2018-05-02 05:15:22,370 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1630419880_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1630419880_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 8955ms. 2018-05-02 05:15:31,331 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1630419880_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1630419880_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 18610ms. 2018-05-02 05:16:14,984 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:16:14,985 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:16:14,989 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:16:15,499 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:16:15,720 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:16:15,720 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:16:15,845 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:16:15,845 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:16:15,845 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:16:15,856 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:16:15,859 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:16:15,859 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:17:39,904 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:17:39,907 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 znode expired, triggering replicatorRemoved event 2018-05-02 05:17:39,908 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:18:23,486 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:19:18,532 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568 2018-05-02 05:19:18,534 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568 znode expired, triggering replicatorRemoved event 2018-05-02 05:19:18,534 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:19:19,037 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:19:19,038 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:19:19,038 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:19,040 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:19:19,042 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:19,042 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:19:19,043 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:19,043 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:19:19,043 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:19:19,046 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:19:19,068 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:19:19,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:19:19,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => f3ccd3e0671152671071dbba3e2cb560, NAME => 'test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 05:19:19,069 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 05:19:19,070 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:19:19,070 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 05:19:19,070 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:19:19,070 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:19:19,070 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AuthenticationService 2018-05-02 05:19:19,070 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:19:19,070 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:19:19,070 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=SecureBulkLoadService 2018-05-02 05:19:19,070 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:19:19,070 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:19:19,070 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 05:19:19,071 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:19:19,071 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:19:19,071 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AccessControlService 2018-05-02 05:19:19,071 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:19:19,071 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:19:19,072 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:19:19,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3ccd3e0671152671071dbba3e2cb560 2018-05-02 05:19:19,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:19:19,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:19:19,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:19:19,073 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:19:19,073 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:19:19,091 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 05:19:19,091 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 05:19:19,092 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:19,093 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:19,096 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:19:19,096 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:19:19,097 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:19,099 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:19,235 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 05:19:19,235 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:19,235 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf/0a4f5f73439447d58ac2371e0ea69f1f 2018-05-02 05:19:19,235 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:19,254 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560 2018-05-02 05:19:19,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:19:19,303 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12779.seqid, newMaxSeqId=12779, maxSeqId=12778 2018-05-02 05:19:19,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11512.seqid, newMaxSeqId=11512, maxSeqId=11511 2018-05-02 05:19:19,308 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened f3ccd3e0671152671071dbba3e2cb560; next sequenceid=12779 2018-05-02 05:19:19,311 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11512 2018-05-02 05:19:19,313 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:19:19,313 INFO [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:19:19,318 DEBUG [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:19:19,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:19:19,319 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:19:19,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:19:24,072 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:19:24,074 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:19:24,078 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:19:24,588 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:19:24,731 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=06:09.037 minutes, events=46, succcessCount=46, totalEvents=579, totalSuccessCount=579 2018-05-02 05:19:25,005 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:19:25,006 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:19:25,103 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:19:25,103 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:19:25,103 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:19:25,112 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:19:25,116 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:19:25,116 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:19:45,308 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:19:48,732 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=2, succcessCount=1, totalEvents=1785, totalSuccessCount=580 2018-05-02 05:19:50,867 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:19:53,244 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=7, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:19:53,244 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:20:09,679 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:20:09,700 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:20:09,701 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:20:09,701 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:09,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:20:09,702 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:09,702 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:09,702 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:09,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:20:09,702 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:09,702 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:09,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:20:09,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:20:09,704 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:09,718 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:20:09,718 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:20:09,719 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:09,720 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:09,762 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:20:09,763 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:09,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:20:09,817 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12779.seqid, newMaxSeqId=12779, maxSeqId=12778 2018-05-02 05:20:09,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12779 2018-05-02 05:20:09,828 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:20:09,832 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:20:09,832 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:11,795 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:20:11,797 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:20:11,797 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:20:11,800 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:20:11,801 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:20:11,801 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:20:11,802 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:20:11,802 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:20:11,803 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:20:11,806 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 377 service: ClientService methodName: Mutate size: 295 connection: 172.27.59.154:55684 deadline: 1525238501805, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:11,853 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 378 service: ClientService methodName: Mutate size: 439 connection: 172.27.59.154:55684 deadline: 1525238501853, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:11,912 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 379 service: ClientService methodName: Mutate size: 295 connection: 172.27.59.154:55684 deadline: 1525238501911, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:11,921 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 05:20:11,922 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:20:11,934 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237780134.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:20:12,010 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237780134.meta.1525238411934.meta 2018-05-02 05:20:12,010 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:20:12,020 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:20:12,021 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 05:20:12,021 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:12,021 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 05:20:12,021 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:12,021 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:12,021 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:12,022 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 05:20:12,022 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:12,022 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:12,029 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 05:20:12,049 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 05:20:12,050 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 05:20:12,050 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 05:20:12,050 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 05:20:12,060 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 381 service: ClientService methodName: Mutate size: 439 connection: 172.27.59.154:55684 deadline: 1525238502059, exception=org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region hbase:meta,,1 is opening on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:12,071 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:20:12,071 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:20:12,073 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:12,073 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:12,118 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 382 service: ClientService methodName: Mutate size: 295 connection: 172.27.59.154:55684 deadline: 1525238502118, exception=org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region hbase:meta,,1 is opening on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:12,144 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/731434bd8e064a57ac508e8f45136ec4 2018-05-02 05:20:12,180 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/fc8d03c2f52e446e97b0cc5892683a9b 2018-05-02 05:20:12,180 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:12,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:20:12,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:20:12,198 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:12,199 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:12,257 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100 2018-05-02 05:20:12,258 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:12,271 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 05:20:12,285 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 05:20:12,312 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/282.seqid, newMaxSeqId=282, maxSeqId=281 2018-05-02 05:20:12,324 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=282 2018-05-02 05:20:12,338 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 05:20:12,343 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 05:20:12,343 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:13,057 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 05:20:13,057 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 05:20:14,703 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:14,704 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:14,706 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:15,210 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:15,493 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:15,493 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:20:15,618 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:20:15,618 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:15,618 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:15,626 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:15,633 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:15,633 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:20:16,776 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e." 2018-05-02 05:20:16,776 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close 6cfc24cc3a423e0969138ce2a69be99e, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245. Requested from /172.27.59.154 2018-05-02 05:20:16,777 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:16,777 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 6cfc24cc3a423e0969138ce2a69be99e, disabling compactions & flushes 2018-05-02 05:20:16,777 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:20:16,779 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.92 MB memstore heap size=2.88 MB 2018-05-02 05:20:17,045 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:20:17,206 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.92 MB at sequenceid=12223 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/.tmp/test_cf/cd508c6396b04928b56ea073a30af8a5 2018-05-02 05:20:17,327 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/.tmp/test_cf/cd508c6396b04928b56ea073a30af8a5 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf/cd508c6396b04928b56ea073a30af8a5 2018-05-02 05:20:17,364 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf/cd508c6396b04928b56ea073a30af8a5, entries=13272, sequenceid=12223, filesize=2.0 M 2018-05-02 05:20:17,376 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~1.92 MB/2009140, heap size ~2.88 MB/3015168, currentsize=0 B/0 for 6cfc24cc3a423e0969138ce2a69be99e in 597ms, sequenceid=12223, compaction requested=false 2018-05-02 05:20:17,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12226.seqid, newMaxSeqId=12226, maxSeqId=5 2018-05-02 05:20:17,406 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:17,406 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:17,406 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:17,407 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:20:17,407 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 6cfc24cc3a423e0969138ce2a69be99e move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 record at close sequenceid=12223 2018-05-02 05:20:17,412 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:20:18,399 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560." 2018-05-02 05:20:18,400 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close f3ccd3e0671152671071dbba3e2cb560, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245. Requested from /172.27.59.154 2018-05-02 05:20:18,400 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6." 2018-05-02 05:20:18,400 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close cb06832d0afac8a9bdbe1f92ad565ab6, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245. Requested from /172.27.59.154 2018-05-02 05:20:18,400 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:18,401 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:18,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing f3ccd3e0671152671071dbba3e2cb560, disabling compactions & flushes 2018-05-02 05:20:18,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing cb06832d0afac8a9bdbe1f92ad565ab6, disabling compactions & flushes 2018-05-02 05:20:18,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:20:18,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:20:18,401 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.02 MB memstore heap size=3.03 MB 2018-05-02 05:20:18,458 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12781.seqid, newMaxSeqId=12781, maxSeqId=12779 2018-05-02 05:20:18,464 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:18,464 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:18,464 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:18,464 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:20:18,464 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding f3ccd3e0671152671071dbba3e2cb560 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 record at close sequenceid=12779 2018-05-02 05:20:18,468 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:20:18,643 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.02 MB at sequenceid=12866 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/.tmp/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2 2018-05-02 05:20:18,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/.tmp/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2 2018-05-02 05:20:18,716 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2, entries=13966, sequenceid=12866, filesize=2.1 M 2018-05-02 05:20:18,720 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~2.02 MB/2120002, heap size ~3.03 MB/3178248, currentsize=0 B/0 for cb06832d0afac8a9bdbe1f92ad565ab6 in 319ms, sequenceid=12866, compaction requested=false 2018-05-02 05:20:18,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12869.seqid, newMaxSeqId=12869, maxSeqId=5 2018-05-02 05:20:18,753 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:18,753 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:18,754 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:18,754 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:20:18,754 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding cb06832d0afac8a9bdbe1f92ad565ab6 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 record at close sequenceid=12866 2018-05-02 05:20:18,757 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:20:22,407 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:22,409 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:22,414 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:22,926 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:23,377 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:23,378 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:20:23,475 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:20:23,476 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:23,476 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:23,486 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:23,488 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:23,488 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:20:45,174 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 2018-05-02 05:20:45,176 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 znode expired, triggering replicatorRemoved event 2018-05-02 05:20:45,176 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:20:45,633 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:20:45,655 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:20:45,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 05:20:45,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:20:45,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 05:20:45,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 05:20:45,656 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:45,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 05:20:45,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:45,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:45,657 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:45,656 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:45,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 05:20:45,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:45,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:45,657 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:45,659 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 05:20:45,659 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:45,660 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:45,660 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 05:20:45,660 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:20:45,660 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:45,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 05:20:45,661 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:45,661 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:45,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:20:45,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:20:45,661 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:45,677 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 05:20:45,677 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 05:20:45,678 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=13, currentSize=250.25 KB, freeSize=204.56 MB, maxSize=204.80 MB, heapSize=250.25 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:45,680 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:20:45,680 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:20:45,680 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:45,681 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=13, currentSize=250.25 KB, freeSize=204.56 MB, maxSize=204.80 MB, heapSize=250.25 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:45,682 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:45,724 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 05:20:45,724 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:45,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:20:45,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12279.seqid, newMaxSeqId=12279, maxSeqId=12278 2018-05-02 05:20:45,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12279 2018-05-02 05:20:45,766 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:20:45,772 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:20:45,772 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:45,776 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 05:20:45,777 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:45,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 05:20:45,823 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12777.seqid, newMaxSeqId=12777, maxSeqId=12776 2018-05-02 05:20:45,827 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12777 2018-05-02 05:20:45,831 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:20:45,835 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:20:45,835 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:20:48,740 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:24.009 minutes, events=4, succcessCount=4, totalEvents=583, totalSuccessCount=583 2018-05-02 05:20:48,748 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.015 minutes, events=8, succcessCount=4, totalEvents=1793, totalSuccessCount=584 2018-05-02 05:20:50,660 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:50,661 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:50,663 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:51,169 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:51,476 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:51,477 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:20:51,599 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:20:51,599 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:51,600 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:51,637 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:51,640 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:51,640 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:21:14,984 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:21:14,985 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:21:14,988 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:21:15,493 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:21:15,699 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:21:15,699 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:21:15,765 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:21:15,765 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:21:15,765 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:21:15,771 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:21:15,773 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:21:15,773 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:21:20,445 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:22:12,526 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:22:12,528 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 znode expired, triggering replicatorRemoved event 2018-05-02 05:22:12,528 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:22:48,353 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs Wed May 2 05:23:50 UTC 2018 Terminating regionserver 2018-05-02 05:23:50,334 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:23:50,334 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:23:50,334 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:23:50,334 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:23:50,335 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:23:50,335 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:23:50,335 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:23:50,335 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:23:50,335 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 05:23:50,335 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:23:50,335 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:23:50,335 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:23:50,335 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:23:50,335 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:23:50,335 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:23:50,335 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:23:50,336 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:23:50,336 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:23:50,336 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:23:50,336 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134' ***** 2018-05-02 05:23:50,336 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:23:50,336 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:23:50,336 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:23:50,336 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:23:50,337 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=03:01.597 minutes, events=1, succcessCount=1, totalEvents=584, totalSuccessCount=584 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:23:50,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:23:50,338 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:23:50,338 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,338 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:23:50,338 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:23:50,338 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:23:50,339 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:23:50,340 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 exiting 2018-05-02 05:23:50,361 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:23:50,368 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:23:50,368 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:23:50,369 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:23:50,376 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:23:50,377 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:23:50,377 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:23:50,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:23:50,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:23:50,378 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,378 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,379 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,380 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 05:23:50,380 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 05:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:23:50,380 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:23:50,379 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 05:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:23:50,381 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.92 MB memstore heap size=2.88 MB 2018-05-02 05:23:50,386 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 05:23:50,387 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x374791e6 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:23:50,387 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:23:50,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:23:50,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:23:50,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:23:50,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,389 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 8 regions to close 2018-05-02 05:23:50,389 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Online Regions={51c9fc854cbebfa25ed419e23bd8ac74=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74., 63390c1b726b541c3ebd2a1a8679aaf1=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1., c963eb77dbdc6dbab886dbe4eebba5ad=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad., 2fd8c4d5abf9928da8e8c547a0ca223a=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a., 665f3f34ec072c60acee3dc78af73b62=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62., 8c7dd0ad2a67fa6a32d1f3694eef56eb=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb., 1588230740=hbase:meta,,1.1588230740, 78e8a528d65332a4f7661e8ab427a827=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.} 2018-05-02 05:23:50,390 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,391 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 05:23:50,391 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 05:23:50,391 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=41.72 KB memstore heap size=61.23 KB 2018-05-02 05:23:50,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11514.seqid, newMaxSeqId=11514, maxSeqId=11512 2018-05-02 05:23:50,440 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,440 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,440 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,441 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:23:50,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:23:50,441 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,442 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 2fd8c4d5abf9928da8e8c547a0ca223a, disabling compactions & flushes 2018-05-02 05:23:50,442 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:23:50,442 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.93 MB memstore heap size=2.90 MB 2018-05-02 05:23:50,446 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12281.seqid, newMaxSeqId=12281, maxSeqId=12279 2018-05-02 05:23:50,454 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,454 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,454 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,454 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:23:50,455 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:23:50,455 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,455 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 05:23:50,455 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:23:50,456 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.04 MB memstore heap size=3.06 MB 2018-05-02 05:23:50,573 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=41.72 KB at sequenceid=360 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/efa0b6b1016a4741b5228d99fccb2609 2018-05-02 05:23:50,621 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/efa0b6b1016a4741b5228d99fccb2609 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/efa0b6b1016a4741b5228d99fccb2609 2018-05-02 05:23:50,657 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/efa0b6b1016a4741b5228d99fccb2609, entries=232, sequenceid=360, filesize=42.5 K 2018-05-02 05:23:50,664 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~41.72 KB/42722, heap size ~61.44 KB/62912, currentsize=0 B/0 for 1588230740 in 273ms, sequenceid=360, compaction requested=true 2018-05-02 05:23:50,754 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.93 MB at sequenceid=12304 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/.tmp/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 05:23:50,755 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/363.seqid, newMaxSeqId=363, maxSeqId=282 2018-05-02 05:23:50,758 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,758 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 05:23:50,758 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,759 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,759 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 05:23:50,759 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 05:23:50,779 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/.tmp/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 05:23:50,784 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.92 MB at sequenceid=12225 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/.tmp/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 05:23:50,807 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.04 MB at sequenceid=12978 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/.tmp/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 05:23:50,808 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0, entries=13373, sequenceid=12304, filesize=2.0 M 2018-05-02 05:23:50,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/.tmp/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 05:23:50,810 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~1.93 MB/2024456, heap size ~2.90 MB/3037920, currentsize=0 B/0 for 2fd8c4d5abf9928da8e8c547a0ca223a in 368ms, sequenceid=12304, compaction requested=false 2018-05-02 05:23:50,827 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/.tmp/test_cf/868a78f7e95741e79a50cbc01a299926 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 05:23:50,829 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c, entries=13274, sequenceid=12225, filesize=2.0 M 2018-05-02 05:23:50,831 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.92 MB/2011079, heap size ~2.88 MB/3016680, currentsize=0 B/0 for c963eb77dbdc6dbab886dbe4eebba5ad in 451ms, sequenceid=12225, compaction requested=false 2018-05-02 05:23:50,847 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926, entries=14087, sequenceid=12978, filesize=2.1 M 2018-05-02 05:23:50,850 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~2.04 MB/2137924, heap size ~3.06 MB/3205320, currentsize=0 B/0 for 665f3f34ec072c60acee3dc78af73b62 in 395ms, sequenceid=12978, compaction requested=false 2018-05-02 05:23:50,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12307.seqid, newMaxSeqId=12307, maxSeqId=5 2018-05-02 05:23:50,860 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12228.seqid, newMaxSeqId=12228, maxSeqId=5 2018-05-02 05:23:50,862 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,862 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,862 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,862 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:23:50,862 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:23:50,862 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,863 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 05:23:50,863 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:23:50,864 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,864 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,864 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,864 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:23:50,864 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:23:50,864 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:50,864 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 05:23:50,865 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:23:50,867 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12981.seqid, newMaxSeqId=12981, maxSeqId=5 2018-05-02 05:23:50,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,875 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:23:50,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:23:50,881 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12779.seqid, newMaxSeqId=12779, maxSeqId=12777 2018-05-02 05:23:50,883 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12781.seqid, newMaxSeqId=12781, maxSeqId=12779 2018-05-02 05:23:50,885 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,885 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,885 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,885 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:23:50,886 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:23:50,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:23:50,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:23:50,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:23:50,888 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:23:50,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:23:50,990 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134; all regions closed. 2018-05-02 05:23:50,990 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:23:51,020 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:23:51,020 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237780134.meta:.meta(num 1525238411934) 2018-05-02 05:23:51,020 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:23:51,041 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:23:51,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525237780134:(num 1525237796361) 2018-05-02 05:23:51,041 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:23:51,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 05:23:51,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:23:51,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:23:51,064 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 05:23:51,064 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:23:51,064 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 05:23:51,087 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:23:51,088 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790068, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:23:51,090 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:23:51,090 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x3631f08b2790068 closed 2018-05-02 05:23:51,091 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134; zookeeper connection closed. 2018-05-02 05:23:51,091 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:23:51,097 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:24:15 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:24:18,085 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:24:18,089 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:24:18,090 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:24:18,090 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:24:18,090 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:24:18,540 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:24:18,540 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:24:18,540 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:24:18,540 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:24:18,542 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:24:18,543 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:24:18,544 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020524 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:24:18,545 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:24:18,546 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:24:18,547 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:24:18,547 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:24:18,548 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020524 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:24:18,550 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:24:18,551 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:24:18,554 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:24:18,555 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020524, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:24:18,815 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:24:19,490 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:24:19,601 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:24:20,350 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:24:20,358 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:24:21,146 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:24:21,147 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:24:21,147 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:24:21,293 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:24:21,727 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:24:21,727 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:24:21,801 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:24:23,105 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 05:24:23,155 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:24:23,173 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:24:23,174 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:24:23,174 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:24:23,175 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:24:23,175 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:24:23,634 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:24:24,118 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:24:24,149 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:24:24,378 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 05:24:24,893 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:24:24,897 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:24:24,899 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:24:24,915 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:24:24,919 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:24:24,925 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:24:27,091 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:24:27,109 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:24:27,220 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:24:27,235 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:24:27,235 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:24:27,235 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:24:27,235 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:24:27,235 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:24:27,236 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:24:27,237 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:24:27,237 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:24:27,237 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:24:27,237 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:24:27,237 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:24:27,237 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 05:24:27,237 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:24:27,238 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:24:27,238 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:24:27,239 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@10cd6753 2018-05-02 05:24:27,288 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:24:27,291 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:24:27,307 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:24:27,309 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:24:27 UTC 2018 2018-05-02 05:24:27,309 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:24:27 UTC 2018 2018-05-02 05:24:27,309 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:08:30 UTC 2018 2018-05-02 05:24:27,315 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:24:27,323 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:24:27,333 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00ba, negotiated timeout = 90000 2018-05-02 05:24:27,336 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:24:27,337 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba connected 2018-05-02 05:24:27,366 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:24:27,457 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:24:27,457 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:24:27,463 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:24:27,525 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:24:27,528 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:24:27,529 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:24:27,534 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:24:27,541 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:24:27,600 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:24:27,600 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:24:27,600 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:24:27,641 INFO [main] util.log: Logging initialized @10595ms 2018-05-02 05:24:27,993 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:24:28,032 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:24:28,033 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:24:28,035 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:24:28,036 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:24:28,036 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:24:28,078 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:24:28,079 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:24:28,127 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@26cb5207{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:24:28,127 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:24:28,325 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@71e4b308{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:24:28,330 INFO [main] ssl.SslContextFactory: x509=X509@4cc36c19(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@5a3a1bf9(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:24:28,348 INFO [main] server.AbstractConnector: Started ServerConnector@3aabed8f{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:24:28,348 INFO [main] server.Server: Started @11303ms 2018-05-02 05:24:28,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:24:28,395 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:24:28,421 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:24:28,421 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:24:28,426 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:24:28,465 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x3094877e to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:24:28,476 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3094877e] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/2098889677@3818120a 2018-05-02 05:24:28,477 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3094877e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:24:28,479 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3094877e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:24:28,479 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3094877e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:24:28,486 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3094877e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b279006f, negotiated timeout = 90000 2018-05-02 05:24:28,551 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b261cd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:24:28,554 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48bd40b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:0 2018-05-02 05:24:28,563 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000008:16020 2018-05-02 05:24:28,581 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:24:28,581 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:24:28,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:24:28,604 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:24:28,604 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:24:28,604 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:24:28,604 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:24:28,799 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:24:28,801 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:24:28,805 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:24:28,806 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:24:28,809 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:24:28,810 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:24:28,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:24:28,865 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:24:28,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:24:28,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:24:28,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:24:28,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:24:28,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:24:28,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:24:28,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:24:28,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:24:28,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:24:28,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:24:28,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:24:28,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:24:28,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:24:28,927 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:24:28,972 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:24:28,972 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:24:28,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:24:28,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:24:28,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:24:28,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:24:28,975 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:24:28,981 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:24:28,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:24:28,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:24:28,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:24:28,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:24:28,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:24:28,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:24:28,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:24:28,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:24:28,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:24:28,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:24:28,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:24:28,985 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:24:28,985 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:24:28,985 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:24:28,985 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:24:28,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:24:28,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:24:28,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:24:28,990 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:24:29,003 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:24:29,003 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:24:29,247 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:24:29,549 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:24:31,762 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:24:31,763 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:24:31,958 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:24:32,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:24:32,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:24:32,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:24:32,114 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:24:32,114 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:24:32,159 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237764081 with port=16020, startcode=1525238658606 2018-05-02 05:24:32,282 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:24:32,282 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:24:32,284 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:24:32,415 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:24:32,455 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:24:32,478 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:24:32,480 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:24:32,481 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:24:32,482 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:24:32,482 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:24:32,530 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:24:32,530 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:24:32,530 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:24:32,569 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:24:32,581 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:24:32,839 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:24:32,853 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:24:32,912 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:24:32,926 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:24:32,930 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:24:32,957 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:24:33,072 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:24:33,072 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:24:33,072 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:24:33,073 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:24:33,073 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:24:33,074 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:24:33,074 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:24:33,077 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:24:33,272 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 starting 2018-05-02 05:24:33,275 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:24:33,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:24:33,286 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:24:33,292 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:24:33,296 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:24:33,312 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427] other RSs: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427] 2018-05-02 05:24:33,386 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x1631f08b26c00ba 2018-05-02 05:24:33,386 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:24:33,386 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:24:33,386 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606' 2018-05-02 05:24:33,386 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:24:33,391 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:24:33,395 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:24:33,395 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:24:33,396 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:24:33,396 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606' 2018-05-02 05:24:33,396 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:24:33,396 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:24:33,397 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:24:33,397 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:24:33,397 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:24:36,581 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525238658606, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:24:37,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 512 ms, current pipeline: [] 2018-05-02 05:24:37,263 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525238658606.1525238676582 2018-05-02 05:24:37,264 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:25:08,413 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:25:08,419 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:25:08,420 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:25:08,435 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:25:08,445 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:25:08,446 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:25:08,447 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:25:08,448 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:25:08,448 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:25:08,582 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:25:08,685 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:25:08,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:25:08,722 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:25:08,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 05:25:08,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:25:08,787 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:08,787 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:08,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:25:08,793 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:08,793 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:08,793 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:08,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:25:08,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:08,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:08,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 05:25:08,795 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:08,795 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:08,795 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:08,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 05:25:08,795 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:08,796 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:08,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:25:08,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:25:08,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:25:08,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:25:08,847 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:08,847 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:08,982 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:25:08,982 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:25:09,000 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:25:09,000 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:25:09,018 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:09,018 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:09,033 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:09,034 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:09,273 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:25:09,274 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 05:25:09,279 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:09,279 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:09,309 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:25:09,315 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:25:09,365 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12985.seqid, newMaxSeqId=12985, maxSeqId=12984 2018-05-02 05:25:09,365 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12785.seqid, newMaxSeqId=12785, maxSeqId=12784 2018-05-02 05:25:09,371 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=12985 2018-05-02 05:25:09,372 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12785 2018-05-02 05:25:09,424 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:25:09,424 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:25:09,456 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:25:09,457 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:25:09,459 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:25:09,462 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:25:10,111 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:25:10,137 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:25:10,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 05:25:10,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => cb06832d0afac8a9bdbe1f92ad565ab6, NAME => 'test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 05:25:10,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 05:25:10,139 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:10,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 05:25:10,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AuthenticationService 2018-05-02 05:25:10,139 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:10,139 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:10,139 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:10,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=SecureBulkLoadService 2018-05-02 05:25:10,139 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:10,140 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:10,140 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:10,140 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:10,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 05:25:10,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AccessControlService 2018-05-02 05:25:10,140 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:10,140 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:10,140 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:10,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 05:25:10,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:10,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:25:10,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 05:25:10,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:25:10,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:10,142 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:10,172 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 05:25:10,172 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 05:25:10,173 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:10,175 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:10,177 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 05:25:10,177 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 05:25:10,180 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:10,182 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:10,222 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2 2018-05-02 05:25:10,223 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:10,241 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 05:25:10,246 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 05:25:10,246 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:10,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 05:25:10,269 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12873.seqid, newMaxSeqId=12873, maxSeqId=12872 2018-05-02 05:25:10,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened cb06832d0afac8a9bdbe1f92ad565ab6; next sequenceid=12873 2018-05-02 05:25:10,277 INFO [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:25:10,283 DEBUG [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:25:10,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:25:10,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12783.seqid, newMaxSeqId=12783, maxSeqId=12782 2018-05-02 05:25:10,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12783 2018-05-02 05:25:10,294 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:25:10,299 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:25:10,299 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:25:10,318 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 05:25:10,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => b89f4262e34dfdd1fbea3661f9d50263, NAME => 'hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:25:10,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AuthenticationService 2018-05-02 05:25:10,328 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:10,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=SecureBulkLoadService 2018-05-02 05:25:10,329 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:10,329 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:10,329 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:10,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AccessControlService 2018-05-02 05:25:10,329 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:10,329 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:10,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table acl b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 05:25:10,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 05:25:10,345 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 05:25:10,345 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 05:25:10,347 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:10,348 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:10,358 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:10,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 05:25:10,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=10 2018-05-02 05:25:10,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened b89f4262e34dfdd1fbea3661f9d50263; next sequenceid=11 2018-05-02 05:25:10,417 INFO [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 05:25:10,421 DEBUG [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Finished post open deploy task for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 05:25:10,422 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:25:11,039 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@7059cacd 2018-05-02 05:25:11,041 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:25:11,042 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:25:11,043 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:25:11,046 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790070, negotiated timeout = 10000 2018-05-02 05:25:11,079 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:25:11,086 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:25:11,755 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:11,755 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:25:11,763 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:11,763 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:25:11,764 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:11,764 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:25:11,960 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:25:11,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:25:11,986 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 05:25:11,987 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:11,987 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 05:25:12,000 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:12,000 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:12,000 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:12,000 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 05:25:12,000 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:12,000 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:12,001 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:25:12,001 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:25:12,001 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:12,022 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:25:12,022 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:25:12,024 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:12,025 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:12,056 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 05:25:12,056 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:12,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:25:12,093 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11518.seqid, newMaxSeqId=11518, maxSeqId=11517 2018-05-02 05:25:12,101 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11518 2018-05-02 05:25:12,103 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:25:12,109 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:25:12,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:25:13,827 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:25:13,829 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:25:13,831 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:25:14,342 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:25:14,591 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:25:14,592 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:25:14,770 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:25:14,770 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:25:14,770 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:25:14,776 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:25:14,779 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:25:14,779 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:25:14,913 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:25:14,913 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:25:28,623 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3094877e] zookeeper.ZooKeeper: Session: 0x3631f08b279006f closed 2018-05-02 05:25:28,623 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3094877e-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:25:29,023 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.049 minutes, events=4, succcessCount=2, totalEvents=4, totalSuccessCount=2 2018-05-02 05:26:04,629 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:26:07,635 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:26:07,746 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:26:07,750 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:26:10,641 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:26:13,644 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:26:13,644 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:26:13,644 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:26:13,647 DEBUG [RS-EventLoopGroup-1-7] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:26:13,654 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:26:13,661 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:26:13,661 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:26:13,662 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:26:13,663 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:26:13,663 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:27:09,003 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,005 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 05:27:09,006 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,008 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,010 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:27:09,014 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:27:09,014 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:27:09,014 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:27:09,015 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/2 2018-05-02 05:27:09,015 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:27:37,274 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,276 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:37,276 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,278 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:37,284 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,284 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:37,288 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,288 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,288 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:37,291 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:37,329 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:37,330 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 5bd8c2cd29520d0d27cacb48e7436a6d, NAME => 'test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 05:27:37,330 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:37,330 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AuthenticationService 2018-05-02 05:27:37,331 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:37,331 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 5c3fc4872d744c7bdc4c539ee55dc094, NAME => 'test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:27:37,332 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AuthenticationService 2018-05-02 05:27:37,332 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,332 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => bae4cdead31e3a4da5b719f67722e3d8, NAME => 'test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 05:27:37,332 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=SecureBulkLoadService 2018-05-02 05:27:37,332 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,332 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,332 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,332 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AuthenticationService 2018-05-02 05:27:37,332 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AccessControlService 2018-05-02 05:27:37,332 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,333 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=SecureBulkLoadService 2018-05-02 05:27:37,333 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,333 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,333 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,333 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AccessControlService 2018-05-02 05:27:37,333 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,333 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,333 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:37,332 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,334 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=SecureBulkLoadService 2018-05-02 05:27:37,334 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 963add1708f89627737d4d216f3449df, NAME => 'test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 05:27:37,334 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,334 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,333 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,334 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,334 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,334 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AccessControlService 2018-05-02 05:27:37,334 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AuthenticationService 2018-05-02 05:27:37,335 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,335 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=SecureBulkLoadService 2018-05-02 05:27:37,335 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,335 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 05:27:37,335 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,335 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,335 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AccessControlService 2018-05-02 05:27:37,335 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 05:27:37,335 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,335 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 05:27:37,336 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,336 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,336 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,336 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 05:27:37,336 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 05:27:37,336 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 05:27:37,336 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:37,335 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,336 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,337 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 05:27:37,337 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,336 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:37,337 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,336 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,338 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,337 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:37,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 963add1708f89627737d4d216f3449df 2018-05-02 05:27:37,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:37,338 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,338 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:27:37,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:37,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,387 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:27:37,387 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:27:37,389 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,390 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,396 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 05:27:37,396 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 05:27:37,397 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,398 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,400 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 05:27:37,400 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 05:27:37,401 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,402 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,405 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,406 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 05:27:37,406 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 05:27:37,407 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,409 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 05:27:37,409 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 05:27:37,412 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,412 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,414 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,416 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,417 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,419 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:27:37,421 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,423 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 05:27:37,435 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 05:27:37,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df 2018-05-02 05:27:37,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 05:27:37,577 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,577 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=2 2018-05-02 05:27:37,578 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,578 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 963add1708f89627737d4d216f3449df; next sequenceid=2 2018-05-02 05:27:37,578 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,578 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 5bd8c2cd29520d0d27cacb48e7436a6d; next sequenceid=2 2018-05-02 05:27:37,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,582 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened bae4cdead31e3a4da5b719f67722e3d8; next sequenceid=2 2018-05-02 05:27:37,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,583 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 5c3fc4872d744c7bdc4c539ee55dc094; next sequenceid=2 2018-05-02 05:27:37,586 INFO [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:37,586 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:37,586 INFO [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:37,594 INFO [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:37,599 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:37,603 INFO [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:37,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:37,604 DEBUG [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:37,604 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:37,604 DEBUG [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:37,606 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:37,608 DEBUG [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:37,608 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:37,613 DEBUG [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:37,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:38,513 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d." 2018-05-02 05:27:38,532 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 5bd8c2cd29520d0d27cacb48e7436a6d without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,536 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,536 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 5bd8c2cd29520d0d27cacb48e7436a6d, disabling compactions & flushes 2018-05-02 05:27:38,536 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:38,539 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8." 2018-05-02 05:27:38,539 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close bae4cdead31e3a4da5b719f67722e3d8 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,540 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df." 2018-05-02 05:27:38,540 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 963add1708f89627737d4d216f3449df without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,540 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing bae4cdead31e3a4da5b719f67722e3d8, disabling compactions & flushes 2018-05-02 05:27:38,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:38,553 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62." 2018-05-02 05:27:38,554 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 3bbeffd33dfc99ea8862c8eae819df62 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,554 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,556 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 963add1708f89627737d4d216f3449df, disabling compactions & flushes 2018-05-02 05:27:38,556 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:38,641 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,656 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,656 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,658 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:38,673 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094." 2018-05-02 05:27:38,673 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 5c3fc4872d744c7bdc4c539ee55dc094 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:38,674 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 05:27:38,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,710 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:38,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,711 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:38,717 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:38,718 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 5c3fc4872d744c7bdc4c539ee55dc094, disabling compactions & flushes 2018-05-02 05:27:38,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:38,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:38,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,749 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:38,754 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:38,800 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,828 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:38,836 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:40,571 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:40,590 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:40,591 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:40,591 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:40,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 05:27:40,592 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:40,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 5c3fc4872d744c7bdc4c539ee55dc094, NAME => 'test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:27:40,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 5bd8c2cd29520d0d27cacb48e7436a6d, NAME => 'test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 05:27:40,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AuthenticationService 2018-05-02 05:27:40,592 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=SecureBulkLoadService 2018-05-02 05:27:40,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => bae4cdead31e3a4da5b719f67722e3d8, NAME => 'test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 05:27:40,592 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,592 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,592 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AccessControlService 2018-05-02 05:27:40,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AuthenticationService 2018-05-02 05:27:40,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AuthenticationService 2018-05-02 05:27:40,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=SecureBulkLoadService 2018-05-02 05:27:40,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,593 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,593 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 05:27:40,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,593 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=SecureBulkLoadService 2018-05-02 05:27:40,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,593 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,593 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 05:27:40,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AccessControlService 2018-05-02 05:27:40,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 05:27:40,593 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,593 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:40,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,594 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AccessControlService 2018-05-02 05:27:40,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,594 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 05:27:40,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:40,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 05:27:40,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:40,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 05:27:40,595 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 963add1708f89627737d4d216f3449df, NAME => 'test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 05:27:40,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:27:40,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:40,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AuthenticationService 2018-05-02 05:27:40,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=SecureBulkLoadService 2018-05-02 05:27:40,596 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,596 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AccessControlService 2018-05-02 05:27:40,596 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 963add1708f89627737d4d216f3449df 2018-05-02 05:27:40,597 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:40,597 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,617 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:27:40,617 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:27:40,618 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,619 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,621 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 05:27:40,621 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 05:27:40,621 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 05:27:40,621 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 05:27:40,622 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 05:27:40,622 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 05:27:40,623 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,623 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 05:27:40,623 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,623 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 05:27:40,623 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,623 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,623 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,624 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,625 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,626 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,627 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,628 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,629 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,634 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,637 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:27:40,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 05:27:40,658 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df 2018-05-02 05:27:40,659 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 05:27:40,673 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 05:27:40,815 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,840 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=5 2018-05-02 05:27:40,844 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:40,849 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:27:40,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:40,858 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,859 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,877 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 5c3fc4872d744c7bdc4c539ee55dc094; next sequenceid=5 2018-05-02 05:27:40,877 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 963add1708f89627737d4d216f3449df; next sequenceid=5 2018-05-02 05:27:40,880 INFO [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:40,880 INFO [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:40,884 DEBUG [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:27:40,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:40,884 DEBUG [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:27:40,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:40,889 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened bae4cdead31e3a4da5b719f67722e3d8; next sequenceid=5 2018-05-02 05:27:40,894 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 5bd8c2cd29520d0d27cacb48e7436a6d; next sequenceid=5 2018-05-02 05:27:40,895 INFO [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:40,900 DEBUG [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:27:40,900 INFO [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:40,900 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:40,904 DEBUG [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:27:40,904 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:27:41,034 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=03:12.155 minutes, events=2, succcessCount=2, totalEvents=2, totalSuccessCount=2 2018-05-02 05:27:42,178 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:27:42,179 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:42,179 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,181 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:42,207 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,207 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:42,209 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,210 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:27:42,210 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:42,336 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:27:42,338 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:27:42,341 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:27:42,852 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:27:42,904 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:27:42,905 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:42,905 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,907 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:42,975 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,976 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:43,106 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:43,106 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:27:43,106 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:43,270 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:27:43,270 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:27:43,375 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:27:43,375 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:27:43,375 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:27:43,380 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:27:43,384 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:27:43,384 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:27:43,817 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 117 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:27:43,817 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 110 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:27:43,818 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 109 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:27:43,818 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:27:44,936 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:27:54,553 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 125 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:27:54,553 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 125 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:27:54,553 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:27:56,000 DEBUG [RS-EventLoopGroup-1-11] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:27:59,006 DEBUG [RS-EventLoopGroup-1-12] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:28:01,614 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:28:01,623 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:28:02,014 DEBUG [RS-EventLoopGroup-1-13] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:28:05,019 DEBUG [RS-EventLoopGroup-1-14] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:28:05,026 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will send token of size 736 from initSASLContext. 2018-05-02 05:28:05,082 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 107 for processing by initSASLContext 2018-05-02 05:28:05,082 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:28:05,084 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:28:05,085 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:28:05,085 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:28:23,555 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 119 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:28:29,050 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.018 minutes, events=1435, succcessCount=234, totalEvents=1439, totalSuccessCount=236 2018-05-02 05:28:37,803 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:28:41,037 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=257, succcessCount=257, totalEvents=259, totalSuccessCount=259 2018-05-02 05:28:59,737 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:28:59,737 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:28:59,737 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:29:24,913 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:29:29,052 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=1067, succcessCount=276, totalEvents=2506, totalSuccessCount=512 2018-05-02 05:29:29,979 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 119 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:29:29,979 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 118 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:29:29,984 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 122 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:29:33,297 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=5, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:29:33,297 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:29:41,043 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=276, succcessCount=276, totalEvents=535, totalSuccessCount=535 2018-05-02 05:29:45,896 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:30:13,825 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:30:13,827 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:30:13,837 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:30:14,359 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:30:14,672 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:30:14,672 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:30:14,743 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:30:14,743 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:30:14,744 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:30:14,750 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:30:14,752 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:30:14,752 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:30:32,044 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:02.992 minutes, events=438, succcessCount=138, totalEvents=2944, totalSuccessCount=650 2018-05-02 05:30:37,106 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:30:37,111 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 1 failover attempts. Trying to failover after sleeping for 1061ms. 2018-05-02 05:30:38,174 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 2 failover attempts. Trying to failover after sleeping for 1658ms. 2018-05-02 05:30:39,834 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 3 failover attempts. Trying to failover after sleeping for 2049ms. 2018-05-02 05:30:41,886 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 4 failover attempts. Trying to failover after sleeping for 10875ms. 2018-05-02 05:30:52,764 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 5 failover attempts. Trying to failover after sleeping for 8940ms. 2018-05-02 05:31:01,706 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 6 failover attempts. Trying to failover after sleeping for 20768ms. 2018-05-02 05:31:22,477 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 7 failover attempts. Trying to failover after sleeping for 16402ms. 2018-05-02 05:31:38,881 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Trying to failover after sleeping for 17554ms. 2018-05-02 05:31:56,456 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Trying to failover after sleeping for 15924ms. 2018-05-02 05:32:12,400 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-211050256_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-211050256_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 19994ms. 2018-05-02 05:32:32,403 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-211050256_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-211050256_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 10043ms. 2018-05-02 05:32:42,451 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-211050256_1. Name node is in safe mode. The reported blocks 286 needs additional 18 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-211050256_1. Name node is in safe mode. The reported blocks 286 needs additional 18 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 16466ms. 2018-05-02 05:34:24,912 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:34:33,296 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=6, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:34:33,297 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:35:05,945 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:35:05,948 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 znode expired, triggering replicatorRemoved event 2018-05-02 05:35:05,951 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:35:06,786 DEBUG [RS-EventLoopGroup-1-15] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:35:06,787 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:35:06,787 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:35:06,789 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:35:06,791 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:35:06,791 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:35:06,791 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:35:06,792 DEBUG [RS-EventLoopGroup-1-15] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:35:06,792 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:35:06,795 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:35:06,825 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:35:06,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:35:06,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 05:35:06,828 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:35:06,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 05:35:06,828 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:35:06,828 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:35:06,828 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:35:06,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 05:35:06,829 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:35:06,829 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:35:06,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:35:06,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:35:06,830 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:06,850 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:35:06,851 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:35:06,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:35:06,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:35:06,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:35:06,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 05:35:06,852 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:35:06,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 05:35:06,852 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:35:06,852 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:35:06,852 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:35:06,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 05:35:06,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 05:35:06,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 05:35:06,852 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:35:06,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 05:35:06,852 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:35:06,852 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:35:06,853 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:35:06,852 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:35:06,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:35:06,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 05:35:06,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:35:06,853 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:35:06,853 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:35:06,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 05:35:06,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:35:06,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:35:06,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 05:35:06,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:35:06,853 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:35:06,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:35:06,853 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:35:06,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:35:06,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:35:06,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:35:06,854 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:35:06,854 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:35:06,854 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:06,854 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:06,854 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:06,872 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:35:06,872 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:35:06,873 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:06,875 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:35:06,879 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:35:06,880 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:35:06,880 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:06,881 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:35:06,907 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:35:06,907 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:35:06,908 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:06,908 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:35:06,913 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:35:06,913 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:35:06,914 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:06,915 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:35:07,072 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 05:35:07,072 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:35:07,110 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 05:35:07,110 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:35:07,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:35:07,151 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 05:35:07,152 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:35:07,169 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:35:07,176 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:35:07,282 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 05:35:07,282 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:35:07,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12062.seqid, newMaxSeqId=12062, maxSeqId=12061 2018-05-02 05:35:07,320 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11453.seqid, newMaxSeqId=11453, maxSeqId=11452 2018-05-02 05:35:07,328 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:35:07,329 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12758.seqid, newMaxSeqId=12758, maxSeqId=12757 2018-05-02 05:35:07,344 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12062 2018-05-02 05:35:07,344 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11453 2018-05-02 05:35:07,348 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:35:07,348 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:35:07,351 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12758 2018-05-02 05:35:07,352 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:35:07,352 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:35:07,352 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:35:07,352 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:35:07,358 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:35:07,361 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:35:07,362 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:35:07,410 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13455.seqid, newMaxSeqId=13455, maxSeqId=13454 2018-05-02 05:35:07,419 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13455 2018-05-02 05:35:07,422 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:35:07,426 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:35:07,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:35:11,065 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=05:30.023 minutes, events=115, succcessCount=115, totalEvents=650, totalSuccessCount=650 2018-05-02 05:35:11,830 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:35:11,831 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:35:11,835 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:35:12,341 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:35:12,622 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:35:12,623 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:35:12,683 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:35:12,683 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:35:12,683 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:35:12,688 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:35:12,689 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:35:12,690 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:35:32,066 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=4, succcessCount=2, totalEvents=2948, totalSuccessCount=652 2018-05-02 05:35:50,846 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:36:42,935 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 2018-05-02 05:36:42,937 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 znode expired, triggering replicatorRemoved event 2018-05-02 05:36:42,937 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:36:44,409 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:36:44,428 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:36:44,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => f3ccd3e0671152671071dbba3e2cb560, NAME => 'test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 05:36:44,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AuthenticationService 2018-05-02 05:36:44,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=SecureBulkLoadService 2018-05-02 05:36:44,430 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,430 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AccessControlService 2018-05-02 05:36:44,431 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3ccd3e0671152671071dbba3e2cb560 2018-05-02 05:36:44,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:36:44,432 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,443 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:36:44,443 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:36:44,443 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:36:44,443 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 05:36:44,443 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 05:36:44,443 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 29fe0b7866912efc70bb3f2d7fd83059, NAME => 'test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 05:36:44,444 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,444 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 084aa7d8a3bd4d7483494d5a2c39d5df, NAME => 'test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 05:36:44,444 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AuthenticationService 2018-05-02 05:36:44,444 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,444 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 05:36:44,444 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,444 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,444 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,444 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,445 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,444 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,445 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,445 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=SecureBulkLoadService 2018-05-02 05:36:44,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AuthenticationService 2018-05-02 05:36:44,445 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,445 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,445 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 05:36:44,445 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 05:36:44,445 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,445 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,445 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=SecureBulkLoadService 2018-05-02 05:36:44,445 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,445 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,445 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,445 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,445 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 05:36:44,445 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,445 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AccessControlService 2018-05-02 05:36:44,445 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,446 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,446 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:36:44,446 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AccessControlService 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:36:44,446 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,446 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,446 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,446 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,446 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 05:36:44,447 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,447 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:36:44,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:36:44,447 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 05:36:44,448 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,459 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 05:36:44,459 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 05:36:44,461 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,461 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,490 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:36:44,490 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:36:44,490 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 05:36:44,490 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 05:36:44,490 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:36:44,491 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:36:44,491 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:36:44,491 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:36:44,491 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,491 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,492 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,492 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,492 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,492 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,493 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,494 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,539 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 05:36:44,539 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 05:36:44,539 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,540 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,580 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf/0a4f5f73439447d58ac2371e0ea69f1f 2018-05-02 05:36:44,580 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,627 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560 2018-05-02 05:36:44,636 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 05:36:44,636 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,637 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf/9f7cb69b6abe4f57bb56248fe3e04156 2018-05-02 05:36:44,637 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,650 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 05:36:44,650 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,656 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf/25e0a99365ef45e2b122cf95cdb0162d 2018-05-02 05:36:44,656 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,666 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 05:36:44,668 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 05:36:44,668 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,671 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:36:44,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:36:44,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 05:36:44,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:36:44,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12785.seqid, newMaxSeqId=12785, maxSeqId=12784 2018-05-02 05:36:44,786 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened f3ccd3e0671152671071dbba3e2cb560; next sequenceid=12785 2018-05-02 05:36:44,793 INFO [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:36:44,797 DEBUG [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:36:44,797 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:36:44,802 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13214.seqid, newMaxSeqId=13214, maxSeqId=13213 2018-05-02 05:36:44,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12707.seqid, newMaxSeqId=12707, maxSeqId=12706 2018-05-02 05:36:44,808 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12590.seqid, newMaxSeqId=12590, maxSeqId=12589 2018-05-02 05:36:44,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12746.seqid, newMaxSeqId=12746, maxSeqId=12745 2018-05-02 05:36:44,811 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12522.seqid, newMaxSeqId=12522, maxSeqId=12521 2018-05-02 05:36:44,819 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13214 2018-05-02 05:36:44,820 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=12707 2018-05-02 05:36:44,822 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:36:44,824 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:36:44,827 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:36:44,827 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:36:44,827 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:36:44,827 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:36:44,837 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 084aa7d8a3bd4d7483494d5a2c39d5df; next sequenceid=12590 2018-05-02 05:36:44,837 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 29fe0b7866912efc70bb3f2d7fd83059; next sequenceid=12746 2018-05-02 05:36:44,843 INFO [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 05:36:44,843 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12522 2018-05-02 05:36:44,846 DEBUG [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 05:36:44,846 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:36:44,847 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:36:44,854 INFO [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 05:36:44,855 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:36:44,855 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:36:44,861 DEBUG [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 05:36:44,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:36:49,431 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:36:49,433 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:36:49,435 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:36:49,938 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:36:50,069 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:39.004 minutes, events=2, succcessCount=2, totalEvents=652, totalSuccessCount=652 2018-05-02 05:36:50,264 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:36:50,264 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:36:50,325 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:36:50,325 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:36:50,325 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:36:50,330 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:36:50,331 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:36:50,332 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:37:21,798 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:37:32,071 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=4, succcessCount=2, totalEvents=2952, totalSuccessCount=654 2018-05-02 05:38:17,995 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:38:17,996 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 05:38:17,999 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:38:18,000 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:38:18,000 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Claimed the leader znode as 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606' 2018-05-02 05:38:18,003 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:38:18,009 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 1 2018-05-02 05:38:18,009 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 2 2018-05-02 05:38:18,009 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 3 2018-05-02 05:38:18,009 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 4 2018-05-02 05:38:18,009 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/3 2018-05-02 05:38:18,010 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 3 2018-05-02 05:38:18,010 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 2018-05-02 05:38:18,014 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 znode expired, triggering replicatorRemoved event 2018-05-02 05:38:18,014 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:38:18,517 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:38:18,584 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:38:18,584 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:38:18,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 682775c01c8d957d744ae2b280c815cd, NAME => 'test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 05:38:18,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AuthenticationService 2018-05-02 05:38:18,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:18,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=SecureBulkLoadService 2018-05-02 05:38:18,586 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:18,586 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:18,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:18,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AccessControlService 2018-05-02 05:38:18,587 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:18,587 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:18,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 682775c01c8d957d744ae2b280c815cd 2018-05-02 05:38:18,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:38:18,588 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:18,588 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:38:18,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 05:38:18,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:18,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 05:38:18,589 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:18,589 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:18,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:18,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 05:38:18,589 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:18,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:18,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:38:18,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:38:18,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:18,604 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 05:38:18,604 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 05:38:18,604 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:18,604 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 05:38:18,605 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:18,605 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:18,605 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:18,605 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 05:38:18,605 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:18,605 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:18,606 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 05:38:18,606 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:38:18,606 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:18,607 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:38:18,607 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 411bd5dbc3845cf91c0d9f4649c84b86, NAME => 'test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 05:38:18,608 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AuthenticationService 2018-05-02 05:38:18,608 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:18,608 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=SecureBulkLoadService 2018-05-02 05:38:18,608 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:18,608 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:18,608 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:18,608 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AccessControlService 2018-05-02 05:38:18,608 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:18,608 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:18,608 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 05:38:18,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:38:18,609 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:18,609 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:38:18,617 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:38:18,617 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:38:18,619 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:18,619 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:18,622 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 05:38:18,622 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 05:38:18,623 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:18,623 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:18,628 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 05:38:18,628 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 05:38:18,632 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 05:38:18,632 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 05:38:18,632 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:18,633 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:18,633 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:18,633 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:18,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:38:18,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 05:38:18,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:18,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 05:38:18,647 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:18,647 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:18,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:18,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 05:38:18,647 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:18,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:18,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 05:38:18,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:38:18,655 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 05:38:18,655 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:18,657 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf/3dabedf14f6c4208ad17e7be0d53907d 2018-05-02 05:38:18,657 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:18,668 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 05:38:18,668 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 05:38:18,669 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:18,669 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:18,673 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf/3e55aa0d1ef34928a8504c63d2ce31e2 2018-05-02 05:38:18,673 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:18,675 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:38:18,676 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 05:38:18,677 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:18,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd 2018-05-02 05:38:18,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 05:38:18,697 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 05:38:18,714 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 05:38:18,714 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:18,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12288.seqid, newMaxSeqId=12288, maxSeqId=12287 2018-05-02 05:38:18,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12490.seqid, newMaxSeqId=12490, maxSeqId=12489 2018-05-02 05:38:18,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12586.seqid, newMaxSeqId=12586, maxSeqId=12585 2018-05-02 05:38:18,726 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12288 2018-05-02 05:38:18,728 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 05:38:18,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12421.seqid, newMaxSeqId=12421, maxSeqId=12420 2018-05-02 05:38:18,734 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:38:18,738 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:38:18,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 682775c01c8d957d744ae2b280c815cd; next sequenceid=12490 2018-05-02 05:38:18,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:38:18,740 INFO [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:38:18,742 DEBUG [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:38:18,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:38:18,746 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 411bd5dbc3845cf91c0d9f4649c84b86; next sequenceid=12586 2018-05-02 05:38:18,746 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12421 2018-05-02 05:38:18,748 INFO [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:38:18,748 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:38:18,751 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:38:18,751 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:38:18,751 DEBUG [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:38:18,752 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:38:18,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/22.seqid, newMaxSeqId=22, maxSeqId=21 2018-05-02 05:38:18,769 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=22 2018-05-02 05:38:18,772 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:38:18,775 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:38:18,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:38:20,076 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:30.007 minutes, events=2, succcessCount=2, totalEvents=654, totalSuccessCount=654 2018-05-02 05:38:20,991 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:38:23,588 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:23,589 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:23,592 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:24,099 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:24,504 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:24,505 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:38:24,626 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:38:24,626 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:24,626 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:24,632 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:24,634 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:24,634 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:38:32,076 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=4, succcessCount=2, totalEvents=2956, totalSuccessCount=656 2018-05-02 05:38:47,551 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827." 2018-05-02 05:38:47,551 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 78e8a528d65332a4f7661e8ab427a827, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:47,574 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237." 2018-05-02 05:38:47,574 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:47,574 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close f3db9f9879ed03f488dcb89bea834237, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:38:47,574 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 05:38:47,574 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059." 2018-05-02 05:38:47,574 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:38:47,574 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 29fe0b7866912efc70bb3f2d7fd83059, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:47,575 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:47,575 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:47,575 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 05:38:47,575 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 29fe0b7866912efc70bb3f2d7fd83059, disabling compactions & flushes 2018-05-02 05:38:47,575 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:38:47,575 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 05:38:47,659 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12787.seqid, newMaxSeqId=12787, maxSeqId=12785 2018-05-02 05:38:47,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12064.seqid, newMaxSeqId=12064, maxSeqId=12062 2018-05-02 05:38:47,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:47,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:47,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:47,664 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:38:47,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 78e8a528d65332a4f7661e8ab427a827 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=12785 2018-05-02 05:38:47,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:47,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:47,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12748.seqid, newMaxSeqId=12748, maxSeqId=12746 2018-05-02 05:38:47,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:47,667 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:38:47,668 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding f3db9f9879ed03f488dcb89bea834237 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=12062 2018-05-02 05:38:47,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:38:47,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:38:47,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:47,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:47,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:47,672 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 05:38:47,672 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding 29fe0b7866912efc70bb3f2d7fd83059 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12746 2018-05-02 05:38:47,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 05:38:48,568 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1." 2018-05-02 05:38:48,568 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 63390c1b726b541c3ebd2a1a8679aaf1, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:48,568 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2." 2018-05-02 05:38:48,569 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close aa977fc80ff408457e9257d2ab7afdf2, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:48,569 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:48,569 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:48,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 05:38:48,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 05:38:48,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:38:48,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:38:48,589 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11520.seqid, newMaxSeqId=11520, maxSeqId=11518 2018-05-02 05:38:48,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12524.seqid, newMaxSeqId=12524, maxSeqId=12522 2018-05-02 05:38:48,595 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:48,595 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:48,595 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:48,595 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:38:48,595 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 63390c1b726b541c3ebd2a1a8679aaf1 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=11518 2018-05-02 05:38:48,598 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:38:48,599 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:48,599 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:48,599 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:48,599 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:38:48,599 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding aa977fc80ff408457e9257d2ab7afdf2 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12522 2018-05-02 05:38:48,600 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:38:48,788 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62." 2018-05-02 05:38:48,788 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 665f3f34ec072c60acee3dc78af73b62, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:48,789 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:48,789 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 05:38:48,789 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:38:48,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12987.seqid, newMaxSeqId=12987, maxSeqId=12985 2018-05-02 05:38:48,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:48,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:48,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:48,828 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:38:48,828 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding 665f3f34ec072c60acee3dc78af73b62 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=12985 2018-05-02 05:38:48,831 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:38:49,699 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951." 2018-05-02 05:38:49,699 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 1595f38ee901be7c67b997fe2fc95951, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:38:49,700 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d." 2018-05-02 05:38:49,700 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 5bd8c2cd29520d0d27cacb48e7436a6d, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:49,700 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:49,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 05:38:49,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:38:49,700 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:49,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 5bd8c2cd29520d0d27cacb48e7436a6d, disabling compactions & flushes 2018-05-02 05:38:49,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:38:49,702 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.02 MB memstore heap size=3.03 MB 2018-05-02 05:38:49,726 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11455.seqid, newMaxSeqId=11455, maxSeqId=11453 2018-05-02 05:38:49,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:49,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:49,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:49,732 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:38:49,732 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 1595f38ee901be7c67b997fe2fc95951 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=11453 2018-05-02 05:38:49,734 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:38:50,129 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.02 MB at sequenceid=12865 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/.tmp/test_cf/e3402645d07644fb92ee0b1234e4c0d4 2018-05-02 05:38:50,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/.tmp/test_cf/e3402645d07644fb92ee0b1234e4c0d4 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf/e3402645d07644fb92ee0b1234e4c0d4 2018-05-02 05:38:50,292 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf/e3402645d07644fb92ee0b1234e4c0d4, entries=13978, sequenceid=12865, filesize=2.1 M 2018-05-02 05:38:50,310 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~2.02 MB/2119747, heap size ~3.03 MB/3178776, currentsize=0 B/0 for 5bd8c2cd29520d0d27cacb48e7436a6d in 608ms, sequenceid=12865, compaction requested=false 2018-05-02 05:38:50,344 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/12868.seqid, newMaxSeqId=12868, maxSeqId=5 2018-05-02 05:38:50,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:50,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:50,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:50,349 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:38:50,350 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 5bd8c2cd29520d0d27cacb48e7436a6d move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12865 2018-05-02 05:38:50,352 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 05:38:51,118 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74." 2018-05-02 05:38:51,118 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 51c9fc854cbebfa25ed419e23bd8ac74, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:51,119 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2." 2018-05-02 05:38:51,119 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close bb80fda45cdcaf338a2a3cfb863adfc2, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:51,119 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:51,119 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 05:38:51,119 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:38:51,120 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:51,120 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 05:38:51,120 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:38:51,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12290.seqid, newMaxSeqId=12290, maxSeqId=12288 2018-05-02 05:38:51,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12760.seqid, newMaxSeqId=12760, maxSeqId=12758 2018-05-02 05:38:51,145 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:51,145 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:51,145 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:51,145 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:38:51,145 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding 51c9fc854cbebfa25ed419e23bd8ac74 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12288 2018-05-02 05:38:51,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:38:51,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:51,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:51,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:51,148 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:38:51,148 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding bb80fda45cdcaf338a2a3cfb863adfc2 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=12758 2018-05-02 05:38:51,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:38:51,905 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:38:51,939 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281." 2018-05-02 05:38:51,939 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close a6e0d7561c4f19e78f94d37462588281, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:38:51,939 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df." 2018-05-02 05:38:51,939 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:51,939 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 963add1708f89627737d4d216f3449df, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:51,940 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 05:38:51,940 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:38:51,940 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:51,940 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 963add1708f89627737d4d216f3449df, disabling compactions & flushes 2018-05-02 05:38:51,940 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:38:51,940 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.97 MB memstore heap size=2.95 MB 2018-05-02 05:38:51,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13457.seqid, newMaxSeqId=13457, maxSeqId=13455 2018-05-02 05:38:51,963 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:51,963 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:51,963 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:51,963 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:38:51,964 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding a6e0d7561c4f19e78f94d37462588281 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=13455 2018-05-02 05:38:51,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:38:52,178 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.97 MB at sequenceid=12519 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/.tmp/test_cf/54a9c57c931f4c86bdd73ac84c990e67 2018-05-02 05:38:52,203 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/.tmp/test_cf/54a9c57c931f4c86bdd73ac84c990e67 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf/54a9c57c931f4c86bdd73ac84c990e67 2018-05-02 05:38:52,239 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf/54a9c57c931f4c86bdd73ac84c990e67, entries=13589, sequenceid=12519, filesize=2.1 M 2018-05-02 05:38:52,241 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.97 MB/2067912, heap size ~2.95 MB/3097816, currentsize=0 B/0 for 963add1708f89627737d4d216f3449df in 301ms, sequenceid=12519, compaction requested=false 2018-05-02 05:38:52,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/12522.seqid, newMaxSeqId=12522, maxSeqId=5 2018-05-02 05:38:52,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:52,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:52,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:52,269 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:38:52,269 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding 963add1708f89627737d4d216f3449df move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12519 2018-05-02 05:38:52,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 05:38:52,667 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:52,668 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:52,671 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:53,159 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560." 2018-05-02 05:38:53,159 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close f3ccd3e0671152671071dbba3e2cb560, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:53,159 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df." 2018-05-02 05:38:53,159 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 084aa7d8a3bd4d7483494d5a2c39d5df, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:53,160 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:53,160 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:53,160 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 084aa7d8a3bd4d7483494d5a2c39d5df, disabling compactions & flushes 2018-05-02 05:38:53,160 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing f3ccd3e0671152671071dbba3e2cb560, disabling compactions & flushes 2018-05-02 05:38:53,161 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 05:38:53,161 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:38:53,192 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:53,194 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12787.seqid, newMaxSeqId=12787, maxSeqId=12785 2018-05-02 05:38:53,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12592.seqid, newMaxSeqId=12592, maxSeqId=12590 2018-05-02 05:38:53,219 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:53,219 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:53,219 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:53,219 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:38:53,219 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding f3ccd3e0671152671071dbba3e2cb560 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12785 2018-05-02 05:38:53,222 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:53,222 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 05:38:53,222 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:53,222 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:53,222 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 05:38:53,222 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 084aa7d8a3bd4d7483494d5a2c39d5df move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12590 2018-05-02 05:38:53,224 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 05:38:53,413 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:53,414 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:38:53,877 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:38:53,877 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:53,877 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:53,887 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:53,890 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:53,890 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:38:54,450 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:54,463 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:38:54,463 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 05:38:54,464 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:54,464 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 05:38:54,464 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:54,464 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:54,464 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:54,464 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 05:38:54,464 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:54,464 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:54,465 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:38:54,465 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:54,465 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:54,478 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:38:54,478 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:38:54,479 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:54,479 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:54,506 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 05:38:54,507 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:54,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:38:54,534 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12449.seqid, newMaxSeqId=12449, maxSeqId=12448 2018-05-02 05:38:54,551 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12449 2018-05-02 05:38:54,554 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:54,557 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:54,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:38:58,219 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:58,220 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:58,223 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:58,728 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:58,807 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:58,820 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 05:38:58,820 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 05:38:58,820 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:58,820 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 05:38:58,820 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:58,820 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:58,820 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:58,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 05:38:58,821 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:58,821 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:58,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 05:38:58,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:58,822 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:58,832 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 05:38:58,832 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 05:38:58,833 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:58,834 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:58,918 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 05:38:58,918 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:58,927 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 05:38:58,956 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11442.seqid, newMaxSeqId=11442, maxSeqId=11441 2018-05-02 05:38:58,965 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11442 2018-05-02 05:38:58,967 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:58,971 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:58,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:38:59,084 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:59,084 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:38:59,166 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:38:59,166 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:59,166 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:59,174 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:59,176 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:59,176 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:39:03,821 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:39:03,822 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:39:03,825 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:39:04,329 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:39:04,575 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:39:04,576 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:39:04,662 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:39:04,662 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:39:04,662 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:39:04,667 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:39:04,669 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:39:04,669 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:39:24,912 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 05:39:32,079 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=18, succcessCount=9, totalEvents=2974, totalSuccessCount=665 2018-05-02 05:39:33,296 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=3, created chunk count=6, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:39:33,297 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:39:44,791 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:39:44,794 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 znode expired, triggering replicatorRemoved event 2018-05-02 05:39:44,795 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:39:46,280 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:39:46,300 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:39:46,300 INFO [RpcServer.default.FPBQ.Fifo.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:39:46,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 05:39:46,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 05:39:46,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 05:39:46,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 05:39:46,302 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:46,302 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:46,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 05:39:46,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 05:39:46,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:46,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:46,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:46,302 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:46,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:46,302 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:46,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 05:39:46,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 05:39:46,303 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:46,303 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:46,303 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:46,303 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:46,303 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 05:39:46,303 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 05:39:46,303 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:39:46,303 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:39:46,304 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:46,304 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:46,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 670f6b815d2acac905130e5440d59304, NAME => 'test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 05:39:46,309 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AuthenticationService 2018-05-02 05:39:46,309 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:46,309 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=SecureBulkLoadService 2018-05-02 05:39:46,310 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:46,310 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:46,310 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:46,310 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AccessControlService 2018-05-02 05:39:46,310 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:46,310 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:46,310 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 670f6b815d2acac905130e5440d59304 2018-05-02 05:39:46,310 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:39:46,311 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:46,318 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:39:46,318 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:39:46,319 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:46,319 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:46,320 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 05:39:46,320 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 05:39:46,321 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:46,321 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:46,323 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 05:39:46,323 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 05:39:46,323 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:46,323 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:46,354 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 05:39:46,355 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:46,356 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf/f5f702b4ca0c43be911590949f4eda41 2018-05-02 05:39:46,356 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:46,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304 2018-05-02 05:39:46,364 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 05:39:46,364 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 05:39:46,364 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:46,369 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 05:39:46,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12190.seqid, newMaxSeqId=12190, maxSeqId=12189 2018-05-02 05:39:46,393 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12539.seqid, newMaxSeqId=12539, maxSeqId=12538 2018-05-02 05:39:46,400 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 670f6b815d2acac905130e5440d59304; next sequenceid=12190 2018-05-02 05:39:46,406 INFO [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:39:46,406 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12539 2018-05-02 05:39:46,409 DEBUG [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:39:46,409 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12780.seqid, newMaxSeqId=12780, maxSeqId=12779 2018-05-02 05:39:46,409 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:39:46,411 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:39:46,413 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12780 2018-05-02 05:39:46,414 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:39:46,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:39:46,424 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:39:46,427 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:39:46,427 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:39:50,079 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:30.003 minutes, events=11, succcessCount=11, totalEvents=665, totalSuccessCount=665 2018-05-02 05:39:51,303 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:39:51,305 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:39:51,309 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:39:51,813 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:39:52,069 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:39:52,069 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:39:52,131 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:39:52,131 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:39:52,131 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:39:52,136 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:39:52,137 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:39:52,137 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:40:13,825 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:40:13,826 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:40:13,829 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:40:14,332 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:40:14,522 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:40:14,523 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:40:14,582 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:40:14,582 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:40:14,582 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:40:14,587 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:40:14,589 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:40:14,589 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:40:18,530 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:40:32,081 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=4, succcessCount=2, totalEvents=2978, totalSuccessCount=667 Wed May 2 05:41:11 UTC 2018 Terminating regionserver 2018-05-02 05:41:11,210 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:41:11,210 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:41:11,210 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:41:11,210 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:41:11,210 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:41:11,210 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:41:11,210 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:41:11,210 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:41:11,210 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 05:41:11,210 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:41:11,210 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:41:11,211 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:41:11,211 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:41:11,211 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:41:11,211 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:41:11,211 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@1d0a61c8 2018-05-02 05:41:11,211 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:41:11,211 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:41:11,211 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606' ***** 2018-05-02 05:41:11,211 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:41:11,211 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:41:11,212 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:21.133 minutes, events=2, succcessCount=2, totalEvents=667, totalSuccessCount=667 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:41:11,212 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:41:11,212 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:41:11,214 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,214 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:41:11,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:41:11,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:41:11,215 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:41:11,215 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 exiting 2018-05-02 05:41:11,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@71e4b308{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:41:11,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@3aabed8f{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:41:11,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:41:11,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@26cb5207{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:41:11,238 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:41:11,238 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:41:11,238 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:41:11,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:41:11,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:41:11,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,240 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,241 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,241 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 411bd5dbc3845cf91c0d9f4649c84b86, disabling compactions & flushes 2018-05-02 05:41:11,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 05:41:11,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:41:11,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:41:11,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,242 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,242 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 05:41:11,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:41:11,242 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,242 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,242 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,243 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,243 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,244 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,244 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,244 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,244 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:41:11,245 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 05:41:11,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x3094877e to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:41:11,246 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:41:11,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 17 regions to close 2018-05-02 05:41:11,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12451.seqid, newMaxSeqId=12451, maxSeqId=12449 2018-05-02 05:41:11,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12588.seqid, newMaxSeqId=12588, maxSeqId=12586 2018-05-02 05:41:11,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12782.seqid, newMaxSeqId=12782, maxSeqId=12780 2018-05-02 05:41:11,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,290 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:41:11,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:41:11,290 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 05:41:11,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:41:11,295 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,295 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,295 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,295 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:41:11,296 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:41:11,296 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,296 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 5c3fc4872d744c7bdc4c539ee55dc094, disabling compactions & flushes 2018-05-02 05:41:11,296 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:41:11,296 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.91 MB memstore heap size=2.87 MB 2018-05-02 05:41:11,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,312 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:41:11,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:41:11,313 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 05:41:11,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:41:11,313 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.95 MB memstore heap size=2.93 MB 2018-05-02 05:41:11,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12541.seqid, newMaxSeqId=12541, maxSeqId=12539 2018-05-02 05:41:11,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,330 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:41:11,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:41:11,330 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 682775c01c8d957d744ae2b280c815cd, disabling compactions & flushes 2018-05-02 05:41:11,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:41:11,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12492.seqid, newMaxSeqId=12492, maxSeqId=12490 2018-05-02 05:41:11,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,382 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:41:11,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:41:11,383 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,383 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b89f4262e34dfdd1fbea3661f9d50263, disabling compactions & flushes 2018-05-02 05:41:11,383 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 05:41:11,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=11 2018-05-02 05:41:11,424 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,424 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,424 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,424 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 05:41:11,424 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 05:41:11,424 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,424 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 670f6b815d2acac905130e5440d59304, disabling compactions & flushes 2018-05-02 05:41:11,425 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:41:11,436 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.95 MB at sequenceid=12451 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/.tmp/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 05:41:11,466 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12192.seqid, newMaxSeqId=12192, maxSeqId=12190 2018-05-02 05:41:11,470 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.91 MB at sequenceid=12181 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/.tmp/test_cf/f50a0196e806447fb2330bc9b1168573 2018-05-02 05:41:11,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/.tmp/test_cf/081e4f87bb6141d5bac9d82300027aa3 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 05:41:11,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,488 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:41:11,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:41:11,488 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,489 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 05:41:11,489 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:41:11,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/.tmp/test_cf/f50a0196e806447fb2330bc9b1168573 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf/f50a0196e806447fb2330bc9b1168573 2018-05-02 05:41:11,520 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3, entries=13521, sequenceid=12451, filesize=2.0 M 2018-05-02 05:41:11,524 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~1.95 MB/2049198, heap size ~2.93 MB/3073888, currentsize=0 B/0 for 3bbeffd33dfc99ea8862c8eae819df62 in 210ms, sequenceid=12451, compaction requested=false 2018-05-02 05:41:11,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12785.seqid, newMaxSeqId=12785, maxSeqId=12783 2018-05-02 05:41:11,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,529 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:41:11,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:41:11,529 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,530 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 05:41:11,530 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:41:11,536 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf/f50a0196e806447fb2330bc9b1168573, entries=13236, sequenceid=12181, filesize=2.0 M 2018-05-02 05:41:11,543 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.91 MB/2005419, heap size ~2.87 MB/3008568, currentsize=0 B/0 for 5c3fc4872d744c7bdc4c539ee55dc094 in 247ms, sequenceid=12181, compaction requested=false 2018-05-02 05:41:11,556 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12454.seqid, newMaxSeqId=12454, maxSeqId=5 2018-05-02 05:41:11,558 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12709.seqid, newMaxSeqId=12709, maxSeqId=12707 2018-05-02 05:41:11,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,563 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:41:11,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:41:11,564 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,564 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 05:41:11,564 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:41:11,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,567 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:41:11,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:41:11,567 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 05:41:11,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:41:11,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12184.seqid, newMaxSeqId=12184, maxSeqId=5 2018-05-02 05:41:11,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,580 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:41:11,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:41:11,580 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing bae4cdead31e3a4da5b719f67722e3d8, disabling compactions & flushes 2018-05-02 05:41:11,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:41:11,581 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.94 MB memstore heap size=2.90 MB 2018-05-02 05:41:11,600 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=22 2018-05-02 05:41:11,606 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,606 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,606 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,606 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:41:11,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12423.seqid, newMaxSeqId=12423, maxSeqId=12421 2018-05-02 05:41:11,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:41:11,607 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 05:41:11,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:41:11,616 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,616 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,617 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,617 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:41:11,617 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:41:11,617 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,617 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a8ff96226d546f0ea151823ae73e5a1b, disabling compactions & flushes 2018-05-02 05:41:11,617 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:41:11,641 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13216.seqid, newMaxSeqId=13216, maxSeqId=13214 2018-05-02 05:41:11,646 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11444.seqid, newMaxSeqId=11444, maxSeqId=11442 2018-05-02 05:41:11,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,652 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:41:11,652 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:41:11,652 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:11,652 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing cb06832d0afac8a9bdbe1f92ad565ab6, disabling compactions & flushes 2018-05-02 05:41:11,652 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:41:11,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,655 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:41:11,656 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:41:11,678 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12875.seqid, newMaxSeqId=12875, maxSeqId=12873 2018-05-02 05:41:11,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:41:11,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 05:41:11,721 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.94 MB at sequenceid=12340 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/.tmp/test_cf/bc281d1814c14ba9aae3e3f6022e60f7 2018-05-02 05:41:11,755 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,769 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/.tmp/test_cf/bc281d1814c14ba9aae3e3f6022e60f7 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf/bc281d1814c14ba9aae3e3f6022e60f7 2018-05-02 05:41:11,812 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf/bc281d1814c14ba9aae3e3f6022e60f7, entries=13412, sequenceid=12340, filesize=2.0 M 2018-05-02 05:41:11,825 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.94 MB/2029606, heap size ~2.90 MB/3045576, currentsize=0 B/0 for bae4cdead31e3a4da5b719f67722e3d8 in 245ms, sequenceid=12340, compaction requested=false 2018-05-02 05:41:11,869 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12343.seqid, newMaxSeqId=12343, maxSeqId=5 2018-05-02 05:41:11,877 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:11,877 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:11,877 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:11,877 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:41:11,877 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:41:12,047 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606; all regions closed. 2018-05-02 05:41:12,048 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:41:12,086 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:41:12,086 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525238658606:(num 1525238676582) 2018-05-02 05:41:12,086 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:41:12,087 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 05:41:12,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:41:12,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:41:12,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:41:12,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:41:12,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:41:12,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 05:41:12,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZKLeaderManager: Stepping down as leader 2018-05-02 05:41:12,097 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:41:12,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:41:12,097 DEBUG [ZKSecretWatcher-leaderElector] token.AuthenticationTokenSecretManager: Interrupted waiting for next update java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:351) 2018-05-02 05:41:12,103 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 05:41:12,109 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/4 2018-05-02 05:41:12,112 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:41:12,114 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:41:12,114 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ba, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:41:12,117 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:41:12,118 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x1631f08b26c00ba closed 2018-05-02 05:41:12,118 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606; zookeeper connection closed. 2018-05-02 05:41:12,119 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:41:12,127 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:41:36 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:41:38,928 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:41:38,930 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:41:38,931 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:41:38,931 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:41:38,931 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:41:39,574 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:41:39,575 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:41:39,575 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:41:39,575 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:41:39,577 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:41:39,577 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:41:39,577 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:41:39,578 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:41:39,579 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020541 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:41:39,580 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:41:39,581 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:41:39,582 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:41:39,583 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020541 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:41:39,585 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:41:39,586 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:41:39,586 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:41:39,589 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:41:39,590 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020541, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:41:39,949 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:41:40,435 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:41:40,501 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:41:41,179 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:41:41,187 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:41:41,711 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:41:41,711 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:41:41,712 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:41:41,907 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:41:42,282 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:41:42,282 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:41:42,370 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:41:42,966 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 05:41:43,006 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:41:43,010 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:41:43,010 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:41:43,010 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:41:43,011 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:41:43,011 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:41:43,271 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:41:43,529 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:41:43,551 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:41:43,711 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 05:41:44,051 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:41:44,054 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:41:44,057 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:41:44,070 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:44,072 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:44,077 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:41:45,555 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:41:45,576 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:41:45,718 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:41:45,734 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:41:45,734 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:41:45,734 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:41:45,734 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:41:45,734 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:41:45,735 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:41:45,751 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:41:45,753 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:41:45,815 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:41:45,822 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:41:45,831 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:41:45,848 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:41:45,849 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:41:45 UTC 2018 2018-05-02 05:41:45,850 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:41:45 UTC 2018 2018-05-02 05:41:45,850 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:53:41 UTC 2018 2018-05-02 05:41:45,861 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:41:45,871 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790082, negotiated timeout = 90000 2018-05-02 05:41:45,874 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:41:45,875 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082 connected 2018-05-02 05:41:45,919 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:41:46,067 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:41:46,067 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:41:46,067 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:41:46,067 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:41:46,067 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 05:41:46,078 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:41:46,284 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:41:46,296 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:41:46,301 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:41:46,339 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:41:46,370 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:41:46,455 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:41:46,455 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:41:46,455 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:41:46,503 INFO [main] util.log: Logging initialized @8726ms 2018-05-02 05:41:46,627 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:41:46,651 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:41:46,652 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:41:46,657 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:41:46,658 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:41:46,658 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:41:46,714 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:41:46,717 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:41:46,813 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:41:46,815 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:41:47,302 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:41:47,308 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:41:47,321 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:41:47,321 INFO [main] server.Server: Started @9544ms 2018-05-02 05:41:47,370 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:41:47,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:41:47,415 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:41:47,415 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:41:47,422 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:41:47,458 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x2e18b72d to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:41:47,470 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x2e18b72d] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/2039858924@3c9747ba 2018-05-02 05:41:47,471 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x2e18b72d-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:41:47,473 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x2e18b72d-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:41:47,474 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x2e18b72d-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:41:47,478 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x2e18b72d-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390083, negotiated timeout = 90000 2018-05-02 05:41:47,543 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f6bf3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:41:47,546 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b286d74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:0 2018-05-02 05:41:47,556 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000008:16020 2018-05-02 05:41:47,575 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:41:47,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:41:47,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:41:47,594 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:41:47,594 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:41:47,594 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:41:47,594 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:41:47,791 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:41:47,794 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:41:47,798 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:41:47,798 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:41:47,802 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:41:47,803 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:41:47,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:41:47,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:41:47,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:41:47,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:41:47,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:41:47,854 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:41:47,855 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:41:47,855 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:41:47,855 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:41:47,855 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:41:47,855 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:41:47,855 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:41:47,856 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:41:47,856 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:41:47,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:41:47,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:41:47,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:41:47,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:41:47,905 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:41:47,934 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:41:47,934 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:41:47,936 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:41:47,936 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:41:47,936 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:41:47,936 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:41:47,937 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:41:47,941 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:41:47,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:41:47,943 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:41:47,943 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:41:47,944 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:41:47,944 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:41:47,944 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:41:47,944 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:41:47,944 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:41:47,944 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:41:47,945 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:41:47,945 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:41:47,945 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:41:47,945 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:41:47,946 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:41:47,946 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:41:47,946 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:41:47,951 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:41:47,954 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:41:47,954 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:41:48,130 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:41:48,574 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:41:51,591 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:41:51,797 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:41:51,797 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:41:51,797 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:41:51,799 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:41:51,801 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:41:51,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525238791399 with port=16020, startcode=1525239699656 2018-05-02 05:41:51,957 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:41:51,958 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:41:51,959 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:41:52,094 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:41:52,119 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:41:52,154 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:41:52,158 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:41:52,159 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:41:52,160 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:41:52,160 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:41:52,224 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:41:52,224 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:41:52,224 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:41:52,316 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:41:52,336 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:52,337 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:41:52,393 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:41:52,723 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:41:52,746 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:41:52,800 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:41:52,817 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:41:52,820 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:41:52,850 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:41:52,907 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:41:52,907 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:41:52,907 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:41:52,908 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:41:52,908 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:41:52,908 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:41:52,908 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:41:52,910 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:41:53,061 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:41:53,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:41:53,077 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:41:53,078 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 starting 2018-05-02 05:41:53,089 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:41:53,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:41:53,203 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656] 2018-05-02 05:41:53,250 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x3631f08b2790082 2018-05-02 05:41:53,250 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:41:53,250 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:41:53,250 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656' 2018-05-02 05:41:53,250 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:41:53,252 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:41:53,254 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:41:53,254 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:41:53,254 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:41:53,255 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656' 2018-05-02 05:41:53,255 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:41:53,257 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:41:53,258 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:41:53,259 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:41:53,259 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:41:56,374 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:41:57,115 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 505 ms, current pipeline: [] 2018-05-02 05:41:57,115 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.1525239716376 2018-05-02 05:41:57,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:42:47,509 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x2e18b72d] zookeeper.ZooKeeper: Session: 0x2631f08d9390083 closed 2018-05-02 05:42:47,509 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x2e18b72d-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:43:21,341 DEBUG [RS-EventLoopGroup-1-3] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:43:22,129 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:43:24,344 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:43:24,347 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:25,354 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:26,362 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:27,312 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:43:30,374 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:43:30,374 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:43:30,374 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:43:30,377 DEBUG [RS-EventLoopGroup-1-5] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:43:30,383 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:43:30,440 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:43:30,441 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:43:30,442 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:43:30,443 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:43:30,443 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:44:10,088 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:10,090 DEBUG [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] coordination.ZkSplitLogWorkerCoordination: Current region server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-02 05:44:10,454 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:44:10,459 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 znode expired, triggering replicatorRemoved event 2018-05-02 05:44:10,461 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:44:14,593 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:14,987 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:44:14,994 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:14,994 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:15,003 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:15,014 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:15,015 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:15,017 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:15,018 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:44:15,018 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:15,161 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 05:44:15,165 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:44:15,192 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:44:15,252 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.meta.1525239855192.meta 2018-05-02 05:44:15,252 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 05:44:15,304 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:44:15,391 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 05:44:15,396 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:15,404 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 05:44:15,404 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:15,404 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:15,404 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:15,405 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 05:44:15,406 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:15,406 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:15,410 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 05:44:15,414 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 05:44:15,415 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 05:44:15,488 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 05:44:15,488 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 05:44:15,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:44:15,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:44:15,626 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:15,640 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:15,841 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba 2018-05-02 05:44:15,864 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ba1eb1029b494bc3812c1db310fffa4e 2018-05-02 05:44:15,868 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:15,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:44:15,879 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:44:15,880 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:15,880 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:15,947 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100 2018-05-02 05:44:16,001 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/8b64c97177a74d56bbb40fc595fa8fb4 2018-05-02 05:44:16,001 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:16,041 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 1 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 05:44:16,049 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Replaying edits from hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000000863 2018-05-02 05:44:16,203 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Applied 247, skipped 0, firstSequenceIdInLog=802, maxSequenceIdInLog=863, path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000000863 2018-05-02 05:44:16,204 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=38.81 KB memstore heap size=57.09 KB 2018-05-02 05:44:16,611 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=38.81 KB at sequenceid=863 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/c5c9039fa09e4024a35f277dcc8ec50e 2018-05-02 05:44:16,665 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/c5c9039fa09e4024a35f277dcc8ec50e as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c5c9039fa09e4024a35f277dcc8ec50e 2018-05-02 05:44:16,696 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c5c9039fa09e4024a35f277dcc8ec50e, entries=247, sequenceid=863, filesize=44.9 K 2018-05-02 05:44:16,706 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~38.81 KB/39743, heap size ~57.30 KB/58680, currentsize=0 B/0 for 1588230740 in 502ms, sequenceid=863, compaction requested=true; wal=null 2018-05-02 05:44:16,719 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Deleted recovered.edits file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000000863 2018-05-02 05:44:16,736 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 05:44:16,759 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/864.seqid, newMaxSeqId=864, maxSeqId=800 2018-05-02 05:44:16,765 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=864 2018-05-02 05:44:16,793 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 05:44:16,797 DEBUG [PostOpenDeployTasks:1588230740] regionserver.CompactSplit: Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 05:44:16,805 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:16,817 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 05:44:16,818 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 05:44:16,819 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:16,829 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 282754 starting at candidate #282754 after considering 1 permutations with 1 in ratio 2018-05-02 05:44:16,832 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HStore: 1588230740 - info: Initiating minor compaction (all files) 2018-05-02 05:44:16,832 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HRegion: Starting compaction of info in hbase:meta,,1.1588230740 2018-05-02 05:44:16,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ba1eb1029b494bc3812c1db310fffa4e, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c5c9039fa09e4024a35f277dcc8ec50e] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=276.1 K 2018-05-02 05:44:16,837 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.Compactor: Compacting ba1eb1029b494bc3812c1db310fffa4e, keycount=892, bloomtype=NONE, size=150.0 K, encoding=NONE, seqNum=623, earliestPutTs=1525237806255 2018-05-02 05:44:16,840 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.Compactor: Compacting 719732a22ccb4e58aef5e4ab7c3fb0ba, keycount=460, bloomtype=NONE, size=81.2 K, encoding=NONE, seqNum=796, earliestPutTs=1525239404238 2018-05-02 05:44:16,843 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.Compactor: Compacting c5c9039fa09e4024a35f277dcc8ec50e, keycount=247, bloomtype=NONE, size=44.9 K, encoding=NONE, seqNum=863, earliestPutTs=1525239585982 2018-05-02 05:44:16,870 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:16,871 DEBUG [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] coordination.ZkSplitLogWorkerCoordination: Current region server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-02 05:44:16,874 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] coordination.ZkSplitLogWorkerCoordination: worker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 acquired task /hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474-splitting%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%252C16020%252C1525239334474.1525239355501 2018-05-02 05:44:16,939 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Splitting WAL=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474-splitting/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.1525239355501, length=11651 2018-05-02 05:44:16,941 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474-splitting%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%252C16020%252C1525239334474.1525239355501 2018-05-02 05:44:16,945 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] util.FSHDFSUtils: Recover lease on dfs file hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474-splitting/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.1525239355501 2018-05-02 05:44:16,954 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] util.FSHDFSUtils: Recovered lease, attempt=0 on file=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474-splitting/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.1525239355501 after 9ms 2018-05-02 05:44:16,977 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:17,142 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 299ab8318d1b1d267135f988608683b7: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,148 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for a8ff96226d546f0ea151823ae73e5a1b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,158 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 2fd8c4d5abf9928da8e8c547a0ca223a: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,171 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 94f6ca283dbb4445b2bcdc321b734d28: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,181 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for da9e02fc1fdd80392463141e6bc6cf96: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] throttle.PressureAwareThroughputController: 1588230740#info#compaction#1 average throughput is 0.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 05:44:17,186 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 4c37ee7a4e1210e481debdc2933fc4d2: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,191 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 78e8a528d65332a4f7661e8ab427a827: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,196 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 665f3f34ec072c60acee3dc78af73b62: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,201 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for bb80fda45cdcaf338a2a3cfb863adfc2: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,208 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for ce3059196e012fe2ffadcb5d2b348ce3: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,225 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for a0792481dc7d859b1b63b04bf9adad81: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,236 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for ffde9f4a59ab08d4830f3b671f736ad5: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,242 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 84c55bda386b9aa62a8b4df75ca9b38c: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,248 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 735f841820ff0baa687bc402b169f4a6: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,254 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 26d4b78c3c7d2fdea4d32bb21a3ca5fe: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,268 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 9c38689b653a37956f2ae7364b126f1b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,277 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for b5180eee96b616afdf79578309c66a11: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,288 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for f3db9f9879ed03f488dcb89bea834237: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,294 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/599402593583420685669c3336944659 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/599402593583420685669c3336944659 2018-05-02 05:44:17,303 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for e75a388bc2011feed75bdc1a0e99a9a9: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,313 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 59a7b13a4cf2cd2376c378f77087088d: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,318 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 931a5308337d39ab8fcac37d3a5e5844: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,343 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 3bbeffd33dfc99ea8862c8eae819df62: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,353 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 2859fac3bc772763b3fd1621c2669f2b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 05:44:17,354 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Finishing writing output logs and closing down 2018-05-02 05:44:17,354 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Waiting for split writer threads to finish 2018-05-02 05:44:17,354 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: 3 split writers finished; closing. 2018-05-02 05:44:17,355 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Processed 0 edits across 0 regions; edits skipped=27; log file=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474-splitting/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.1525239355501, length=11651, corrupted=false, progress failed=false 2018-05-02 05:44:17,368 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474-splitting%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%252C16020%252C1525239334474.1525239355501 2018-05-02 05:44:17,369 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coordination.ZkSplitLogWorkerCoordination: successfully transitioned task /hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474-splitting%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%252C16020%252C1525239334474.1525239355501 to final state DONE ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:17,369 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.WALSplitterHandler: Worker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 done with task org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination$ZkSplitTaskDetails@1e17a0dd in 476ms. Status = DONE 2018-05-02 05:44:17,389 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HStore: Completed compaction of 3 (all) file(s) in info of 1588230740 into 599402593583420685669c3336944659(size=163.1 K), total size for store is 163.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 05:44:17,390 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=info, priority=7, startTime=1525239856797; duration=0sec 2018-05-02 05:44:17,394 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 05:44:17,443 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474-splitting%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%252C16020%252C1525239334474.1525239355501 2018-05-02 05:44:17,443 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:17,537 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:44:17,540 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:17,540 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:17,543 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:17,545 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:17,545 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:17,546 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:17,547 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:44:17,547 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:18,072 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:44:18,125 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:44:18,126 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:44:18,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:44:18,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:44:18,126 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:44:18,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 05:44:18,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 05:44:18,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 05:44:18,127 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,127 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 05:44:18,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 05:44:18,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,127 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,127 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 05:44:18,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 05:44:18,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 05:44:18,128 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,128 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,128 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 05:44:18,128 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,128 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,128 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,128 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 05:44:18,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:44:18,129 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,130 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 05:44:18,130 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,130 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:44:18,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:44:18,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:44:18,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:44:18,131 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,131 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,136 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:44:18,137 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:44:18,137 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:44:18,137 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:44:18,137 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 05:44:18,137 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,137 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 05:44:18,137 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,137 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,137 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 05:44:18,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 05:44:18,138 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,138 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 05:44:18,138 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,138 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,138 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,138 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:44:18,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 05:44:18,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:44:18,139 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,139 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:44:18,139 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:44:18,139 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:44:18,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 05:44:18,140 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 05:44:18,140 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,140 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,140 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 05:44:18,140 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,140 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:44:18,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:44:18,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,245 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:44:18,245 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:44:18,251 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:44:18,251 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:44:18,252 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 05:44:18,252 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 05:44:18,258 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,258 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,258 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,258 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:44:18,258 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:44:18,258 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,258 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,259 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,259 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,260 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,263 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:44:18,263 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:44:18,264 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:44:18,264 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:44:18,264 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,265 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,266 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,266 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,313 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 05:44:18,313 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,353 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:44:18,359 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 05:44:18,359 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,361 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 05:44:18,361 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,363 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 05:44:18,363 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,366 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 05:44:18,366 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,378 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 05:44:18,379 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,382 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:44:18,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:44:18,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:44:18,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:44:18,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 05:44:18,462 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12453.seqid, newMaxSeqId=12453, maxSeqId=12452 2018-05-02 05:44:18,493 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12453 2018-05-02 05:44:18,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11878.seqid, newMaxSeqId=11878, maxSeqId=11877 2018-05-02 05:44:18,503 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:44:18,515 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:44:18,515 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:18,530 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=11878 2018-05-02 05:44:18,533 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11987.seqid, newMaxSeqId=11987, maxSeqId=11986 2018-05-02 05:44:18,540 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:44:18,548 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:44:18,549 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:18,561 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=11987 2018-05-02 05:44:18,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12762.seqid, newMaxSeqId=12762, maxSeqId=12761 2018-05-02 05:44:18,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12425.seqid, newMaxSeqId=12425, maxSeqId=12424 2018-05-02 05:44:18,568 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12801.seqid, newMaxSeqId=12801, maxSeqId=12800 2018-05-02 05:44:18,574 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:44:18,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12762 2018-05-02 05:44:18,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12425 2018-05-02 05:44:18,588 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12801 2018-05-02 05:44:18,592 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:44:18,592 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:44:18,592 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:44:18,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:18,595 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:44:18,634 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:44:18,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:18,634 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:44:18,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:18,635 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:44:18,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:20,488 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:44:20,490 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:44:20,493 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:44:21,000 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:44:21,003 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@77581851 2018-05-02 05:44:21,005 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:44:21,012 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:44:21,013 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:44:21,020 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00cb, negotiated timeout = 10000 2018-05-02 05:44:21,052 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:44:21,067 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:44:21,265 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:44:21,266 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:44:21,332 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:44:21,332 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:44:21,332 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:44:21,336 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:44:21,338 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:44:21,338 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:44:22,325 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:22,325 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:44:22,326 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:22,326 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:44:22,327 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 05:44:22,327 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 05:44:22,328 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:22,328 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:44:22,807 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:44:22,807 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:44:22,807 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:44:40,554 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:44:40,557 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:40,557 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:40,560 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:40,576 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:40,577 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:40,580 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:40,580 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:44:40,581 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:47,965 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=8, succcessCount=4, totalEvents=8, totalSuccessCount=4 2018-05-02 05:44:51,913 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 05:44:52,266 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 05:44:52,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 6e9424b67ac115dc3547de9b3eb4c5ef, NAME => 'test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 05:44:52,267 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 05:44:52,268 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 681566c13ee68fa7a27c4bd39d5a79e0, NAME => 'test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 05:44:52,268 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AuthenticationService 2018-05-02 05:44:52,268 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AuthenticationService 2018-05-02 05:44:52,269 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,269 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 05:44:52,269 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=SecureBulkLoadService 2018-05-02 05:44:52,269 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,269 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,269 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,269 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 7386aea828f5bbf6f2bb9358162092e6, NAME => 'test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 05:44:52,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AuthenticationService 2018-05-02 05:44:52,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AccessControlService 2018-05-02 05:44:52,270 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=SecureBulkLoadService 2018-05-02 05:44:52,270 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,270 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,270 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,270 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,270 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,270 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 05:44:52,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AccessControlService 2018-05-02 05:44:52,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 05:44:52,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 05:44:52,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => b03e6835fbab67365568f0d2520e68de, NAME => 'test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 05:44:52,269 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=SecureBulkLoadService 2018-05-02 05:44:52,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AuthenticationService 2018-05-02 05:44:52,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,272 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 05:44:52,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=SecureBulkLoadService 2018-05-02 05:44:52,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AccessControlService 2018-05-02 05:44:52,273 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 5fc7cfd582bc270c530fe9787011078c, NAME => 'test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 05:44:52,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b03e6835fbab67365568f0d2520e68de 2018-05-02 05:44:52,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 05:44:52,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AuthenticationService 2018-05-02 05:44:52,274 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,274 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,274 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 05:44:52,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AccessControlService 2018-05-02 05:44:52,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7386aea828f5bbf6f2bb9358162092e6 2018-05-02 05:44:52,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=SecureBulkLoadService 2018-05-02 05:44:52,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 05:44:52,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 05:44:52,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 05:44:52,275 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 05:44:52,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,276 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 05:44:52,277 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 05:44:52,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,277 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AccessControlService 2018-05-02 05:44:52,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5fc7cfd582bc270c530fe9787011078c 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => ab4e529620b9089675ab2d6f3446a39c, NAME => 'test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c.', STARTKEY => '\x86\xBC\xA1\xAF(k\xCA\x08', ENDKEY => '\x8DyC^P\xD7\x94"'} 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 05:44:52,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AuthenticationService 2018-05-02 05:44:52,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=SecureBulkLoadService 2018-05-02 05:44:52,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AccessControlService 2018-05-02 05:44:52,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => b7a376d86459306e108ed5a76373661f, NAME => 'test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f.', STARTKEY => '\xC3^P\xD7\x945\xE4\xF2', ENDKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C'} 2018-05-02 05:44:52,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am ab4e529620b9089675ab2d6f3446a39c 2018-05-02 05:44:52,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 05:44:52,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=AuthenticationService 2018-05-02 05:44:52,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=SecureBulkLoadService 2018-05-02 05:44:52,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=AccessControlService 2018-05-02 05:44:52,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b7a376d86459306e108ed5a76373661f 2018-05-02 05:44:52,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 05:44:52,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 36261edb1d6e5ae1d91cf96e60680ebc, NAME => 'test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc.', STARTKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF', ENDKEY => ''} 2018-05-02 05:44:52,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 3b0ff50ae790418c1d7b36d704a3c7a8, NAME => 'test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 05:44:52,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=AuthenticationService 2018-05-02 05:44:52,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=SecureBulkLoadService 2018-05-02 05:44:52,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AuthenticationService 2018-05-02 05:44:52,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => d5e9f3919d5e95ad2d6e01e1e16fa8ad, NAME => 'test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=AccessControlService 2018-05-02 05:44:52,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AuthenticationService 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 36261edb1d6e5ae1d91cf96e60680ebc 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=SecureBulkLoadService 2018-05-02 05:44:52,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 05:44:52,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=SecureBulkLoadService 2018-05-02 05:44:52,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AccessControlService 2018-05-02 05:44:52,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AccessControlService 2018-05-02 05:44:52,287 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 05:44:52,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 05:44:52,287 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 05:44:52,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 05:44:52,288 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,356 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 05:44:52,356 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 05:44:52,358 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,358 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,373 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,375 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 05:44:52,375 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 05:44:52,376 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 05:44:52,376 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 05:44:52,376 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,377 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,377 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,378 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 05:44:52,378 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 05:44:52,378 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,379 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,379 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de 2018-05-02 05:44:52,381 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,383 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1 2018-05-02 05:44:52,383 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1 2018-05-02 05:44:52,383 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,383 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 05:44:52,383 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 05:44:52,384 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,384 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,385 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,385 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,386 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,388 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 05:44:52,388 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 05:44:52,388 DEBUG [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/f1 2018-05-02 05:44:52,388 DEBUG [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/f1 2018-05-02 05:44:52,389 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 05:44:52,389 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 05:44:52,389 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,390 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,390 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,391 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,392 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,393 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 05:44:52,393 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 05:44:52,393 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 05:44:52,393 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 05:44:52,394 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,394 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,394 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,395 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,395 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,398 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6 2018-05-02 05:44:52,399 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c 2018-05-02 05:44:52,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f 2018-05-02 05:44:52,402 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,404 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 05:44:52,406 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,407 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc 2018-05-02 05:44:52,461 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,464 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 05:44:52,484 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c 2018-05-02 05:44:52,533 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,533 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened b03e6835fbab67365568f0d2520e68de; next sequenceid=2 2018-05-02 05:44:52,540 INFO [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 05:44:52,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,550 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 6e9424b67ac115dc3547de9b3eb4c5ef; next sequenceid=2 2018-05-02 05:44:52,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,550 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 681566c13ee68fa7a27c4bd39d5a79e0; next sequenceid=2 2018-05-02 05:44:52,551 DEBUG [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 05:44:52,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,555 INFO [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 05:44:52,555 INFO [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 05:44:52,562 DEBUG [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 05:44:52,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,562 DEBUG [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 05:44:52,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,571 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,571 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 7386aea828f5bbf6f2bb9358162092e6; next sequenceid=2 2018-05-02 05:44:52,575 INFO [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 05:44:52,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,582 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened d5e9f3919d5e95ad2d6e01e1e16fa8ad; next sequenceid=2 2018-05-02 05:44:52,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,584 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened b7a376d86459306e108ed5a76373661f; next sequenceid=2 2018-05-02 05:44:52,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,584 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 5fc7cfd582bc270c530fe9787011078c; next sequenceid=2 2018-05-02 05:44:52,585 DEBUG [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 05:44:52,585 INFO [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 05:44:52,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,586 INFO [PostOpenDeployTasks:b7a376d86459306e108ed5a76373661f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 05:44:52,586 INFO [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 05:44:52,590 DEBUG [PostOpenDeployTasks:b7a376d86459306e108ed5a76373661f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 05:44:52,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 3b0ff50ae790418c1d7b36d704a3c7a8; next sequenceid=2 2018-05-02 05:44:52,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 36261edb1d6e5ae1d91cf96e60680ebc; next sequenceid=2 2018-05-02 05:44:52,592 DEBUG [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 05:44:52,592 DEBUG [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 05:44:52,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,594 INFO [PostOpenDeployTasks:36261edb1d6e5ae1d91cf96e60680ebc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 05:44:52,594 INFO [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 05:44:52,602 DEBUG [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 05:44:52,602 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,602 DEBUG [PostOpenDeployTasks:36261edb1d6e5ae1d91cf96e60680ebc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 05:44:52,602 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,614 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened ab4e529620b9089675ab2d6f3446a39c; next sequenceid=2 2018-05-02 05:44:52,618 INFO [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 05:44:52,623 DEBUG [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 05:44:52,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:44:52,708 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:44:52,709 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:52,709 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:52,711 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:52,714 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:52,714 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:52,714 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:52,715 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:44:52,715 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:52,810 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:44:57,272 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:44:57,273 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:44:57,277 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:44:57,786 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:44:57,975 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:44:57,975 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:44:58,048 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:44:58,048 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:44:58,048 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:44:58,113 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:44:58,115 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:44:58,115 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:45:00,823 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:45:00,824 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:45:00,824 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:00,827 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:45:00,842 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:00,843 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:45:00,851 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:00,852 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:45:00,852 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:45:47,969 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=2, succcessCount=1, totalEvents=10, totalSuccessCount=5 2018-05-02 05:45:53,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ba1eb1029b494bc3812c1db310fffa4e, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c5c9039fa09e4024a35f277dcc8ec50e] to archive 2018-05-02 05:45:53,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archiving compacted files. 2018-05-02 05:45:53,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ba1eb1029b494bc3812c1db310fffa4e to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/ba1eb1029b494bc3812c1db310fffa4e 2018-05-02 05:45:53,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba 2018-05-02 05:45:53,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c5c9039fa09e4024a35f277dcc8ec50e to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/c5c9039fa09e4024a35f277dcc8ec50e 2018-05-02 05:45:58,557 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:45:58,557 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:58,557 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:45:58,571 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:58,573 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:45:58,573 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:45:59,265 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:45:59,265 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:59,265 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:45:59,277 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:59,279 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:45:59,280 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:45:59,829 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:45:59,830 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:59,830 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:45:59,843 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:59,844 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:45:59,844 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:46:03,018 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:42.054 minutes, events=5, succcessCount=5, totalEvents=5, totalSuccessCount=5 2018-05-02 05:46:07,529 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:46:07,529 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:07,530 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:46:07,549 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:07,551 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:46:07,551 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:46:25,129 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 107 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:46:30,591 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 238 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:46:33,546 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 181 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:46:39,674 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 172 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:46:39,675 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 107 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:46:44,070 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=174.13 KB, freeSize=204.63 MB, max=204.80 MB, blockCount=4, accesses=364, hits=323, hitRatio=88.74%, , cachingAccesses=331, cachingHits=323, cachingHitsRatio=97.58%, evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:46:47,988 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.019 minutes, events=250273, succcessCount=50482, totalEvents=250283, totalSuccessCount=50487 2018-05-02 05:46:53,095 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=47, reused chunk count=1, reuseRatio=2.08% 2018-05-02 05:46:53,105 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:47:01,163 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:47:01,369 DEBUG [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:47:01,372 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.8 MTotal Memstore Off-Heap size=0, Region memstore size=24.1 M 2018-05-02 05:47:01,373 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:47:01,375 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=11.48 MB memstore heap size=24.10 MB 2018-05-02 05:47:03,031 DEBUG [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:47:03,031 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.013 minutes, events=67453, succcessCount=67453, totalEvents=67458, totalSuccessCount=67458 2018-05-02 05:47:03,031 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=208.9 MTotal Memstore Off-Heap size=0, Region memstore size=23.9 M 2018-05-02 05:47:03,032 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:47:03,032 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=11.38 MB memstore heap size=23.88 MB 2018-05-02 05:47:03,379 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=11.48 MB at sequenceid=287 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/.tmp/f1/a3641d2c563f4968adf6f952315d6af8 2018-05-02 05:47:03,439 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/.tmp/f1/a3641d2c563f4968adf6f952315d6af8 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/a3641d2c563f4968adf6f952315d6af8 2018-05-02 05:47:03,496 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/a3641d2c563f4968adf6f952315d6af8, entries=186294, sequenceid=287, filesize=11.3 M 2018-05-02 05:47:03,501 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~11.48 MB/12040840, heap size ~24.10 MB/25274040, currentsize=300.89 KB/308112 for 7386aea828f5bbf6f2bb9358162092e6 in 2126ms, sequenceid=287, compaction requested=false 2018-05-02 05:47:03,851 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 113 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:47:04,047 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=11.38 MB at sequenceid=292 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/.tmp/f1/2a4d0a4a276a427f956af1d693600d04 2018-05-02 05:47:04,085 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/.tmp/f1/2a4d0a4a276a427f956af1d693600d04 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/2a4d0a4a276a427f956af1d693600d04 2018-05-02 05:47:04,136 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/2a4d0a4a276a427f956af1d693600d04, entries=184599, sequenceid=292, filesize=11.2 M 2018-05-02 05:47:04,141 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~11.38 MB/11930800, heap size ~23.88 MB/25044080, currentsize=230.27 KB/235800 for ab4e529620b9089675ab2d6f3446a39c in 1108ms, sequenceid=292, compaction requested=false 2018-05-02 05:47:11,028 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 218 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:47:13,314 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 190 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:47:13,314 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 192 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:47:14,553 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: WAL roll requested 2018-05-02 05:47:14,677 DEBUG [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:47:14,678 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.9 MTotal Memstore Off-Heap size=0, Region memstore size=28.2 M 2018-05-02 05:47:14,678 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:47:14,694 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.44 MB memstore heap size=28.20 MB 2018-05-02 05:47:14,967 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] wal.AbstractFSWAL: Slow sync cost: 398 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:47:14,999 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] wal.AbstractFSWAL: Rolled WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.1525239716376 with entries=3161, filesize=129.27 MB; new WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.1525240034554 2018-05-02 05:47:14,999 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:47:15,150 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] wal.AbstractFSWAL: Rolled WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.meta.1525239855192.meta with entries=125, filesize=95.22 KB; new WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.meta.1525240035001.meta 2018-05-02 05:47:15,151 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:47:17,621 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.44 MB at sequenceid=353 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/.tmp/f1/dbd2816429b24832a77a1b06377230f4 2018-05-02 05:47:17,945 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/.tmp/f1/dbd2816429b24832a77a1b06377230f4 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/dbd2816429b24832a77a1b06377230f4 2018-05-02 05:47:17,972 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/dbd2816429b24832a77a1b06377230f4, entries=217959, sequenceid=353, filesize=13.2 M 2018-05-02 05:47:17,974 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~13.44 MB/14093872, heap size ~28.20 MB/29570032, currentsize=540.38 KB/553344 for 5fc7cfd582bc270c530fe9787011078c in 3295ms, sequenceid=353, compaction requested=false 2018-05-02 05:47:25,187 DEBUG [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:47:25,188 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.9 MTotal Memstore Off-Heap size=0, Region memstore size=31.1 M 2018-05-02 05:47:25,188 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:47:25,188 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=14.84 MB memstore heap size=31.11 MB 2018-05-02 05:47:26,255 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=14.84 MB at sequenceid=390 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/.tmp/f1/6cba47e832104f3da47cbb23a9bc05f2 2018-05-02 05:47:26,319 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/.tmp/f1/6cba47e832104f3da47cbb23a9bc05f2 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/6cba47e832104f3da47cbb23a9bc05f2 2018-05-02 05:47:26,361 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/6cba47e832104f3da47cbb23a9bc05f2, entries=240457, sequenceid=390, filesize=14.6 M 2018-05-02 05:47:26,369 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~14.84 MB/15555832, heap size ~31.11 MB/32622320, currentsize=42.98 KB/44016 for 6e9424b67ac115dc3547de9b3eb4c5ef in 1181ms, sequenceid=390, compaction requested=false 2018-05-02 05:47:40,618 DEBUG [RS-EventLoopGroup-1-15] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:47:40,621 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:47:40,621 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:40,624 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:47:40,637 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:40,637 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:47:40,652 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:40,652 DEBUG [RS-EventLoopGroup-1-15] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:47:40,653 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:47:45,741 DEBUG [RS-EventLoopGroup-1-16] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:47:45,743 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:47:45,743 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:45,745 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:47:45,766 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:45,767 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:47:45,778 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:45,778 DEBUG [RS-EventLoopGroup-1-16] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:47:45,779 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:47:46,078 DEBUG [RS-EventLoopGroup-1-17] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:47:46,080 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:47:46,080 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:46,083 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:47:46,085 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:46,086 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:47:46,087 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:46,087 DEBUG [RS-EventLoopGroup-1-17] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:47:46,087 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:47:50,037 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:02.049 minutes, events=422964, succcessCount=30854, totalEvents=673247, totalSuccessCount=81341 2018-05-02 05:48:20,350 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:20,350 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:20,350 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:20,355 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:20,356 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:20,356 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:20,361 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:20,362 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:20,362 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:20,366 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:20,367 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:20,367 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:22,223 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:22,224 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,224 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:22,247 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,260 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:22,261 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:22,262 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:22,262 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,262 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:22,281 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,284 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:22,285 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:23,054 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:23,054 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:23,054 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:23,071 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:23,072 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:23,072 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:32,122 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:32,123 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:32,123 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:32,148 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:32,150 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:32,151 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:32,733 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:32,733 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:32,733 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:32,763 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:32,764 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:32,764 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:32,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1419660 bytes) of f1 2018-05-02 05:48:32,893 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:32,893 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:32,894 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:32,916 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:32,920 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:32,921 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1410342 bytes) of f1 2018-05-02 05:48:33,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1412886 bytes) of f1 2018-05-02 05:48:35,054 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:32.022 minutes, events=13883, succcessCount=13883, totalEvents=81341, totalSuccessCount=81341 2018-05-02 05:48:43,960 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:43,960 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:43,961 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:43,977 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:43,978 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:43,978 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:44,881 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:44,881 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:44,881 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:44,901 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:44,903 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:44,903 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:49,180 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:49,180 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:49,180 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:49,199 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:49,201 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:49,201 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:50,055 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.019 minutes, events=4, succcessCount=2, totalEvents=673251, totalSuccessCount=81343 2018-05-02 05:48:51,491 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:51,491 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:51,491 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:51,520 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:51,521 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:51,521 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:51,868 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:51,868 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:51,868 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:51,885 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:51,886 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:51,886 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:07,184 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:07,184 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:07,184 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:07,205 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:07,206 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:07,206 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:08,447 DEBUG [RS-EventLoopGroup-1-32] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:49:08,449 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:49:08,449 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:08,452 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:49:08,453 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:08,453 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:49:08,455 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:08,455 DEBUG [RS-EventLoopGroup-1-32] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:49:08,455 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:49:09,390 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:09,390 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:09,390 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:09,405 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:09,406 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:09,406 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:09,789 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:09,789 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:09,789 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:09,809 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:09,811 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:09,811 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:09,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1413474 bytes) of f1 2018-05-02 05:49:10,093 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:10,093 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:10,093 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:10,117 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:10,119 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:10,119 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:10,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468692 bytes) of f1 2018-05-02 05:49:10,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468320 bytes) of f1 2018-05-02 05:49:14,283 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:14,283 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:14,283 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:14,307 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:14,308 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:14,312 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:15,921 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:15,921 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:15,921 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:15,946 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:15,948 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:15,949 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:18,698 DEBUG [RS-EventLoopGroup-1-38] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,701 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:49:18,701 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,719 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:49:18,721 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,722 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:49:18,724 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,724 DEBUG [RS-EventLoopGroup-1-38] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,724 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:49:18,764 DEBUG [RS-EventLoopGroup-1-39] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,766 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:49:18,766 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,768 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:49:18,769 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,769 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:49:18,770 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,770 DEBUG [RS-EventLoopGroup-1-39] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,770 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:49:19,482 DEBUG [RS-EventLoopGroup-1-40] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:49:19,484 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:49:19,484 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:19,487 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:49:19,492 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:19,493 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:49:19,496 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:19,497 DEBUG [RS-EventLoopGroup-1-40] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:49:19,497 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:49:19,499 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:49:19,517 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 05:49:19,518 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 05:49:19,518 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:19,518 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 05:49:19,518 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:19,518 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:19,518 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:19,519 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 05:49:19,519 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:19,519 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:19,520 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:49:19,520 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:49:19,521 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:19,545 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:49:19,545 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:49:19,546 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:19,547 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:19,614 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 05:49:19,618 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:19,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:49:19,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12459.seqid, newMaxSeqId=12459, maxSeqId=12458 2018-05-02 05:49:19,699 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=12459 2018-05-02 05:49:19,705 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:49:19,710 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:49:19,710 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:20,489 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:49:20,497 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:49:20,498 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:49:20,690 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:49:20,712 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:49:20,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 05:49:20,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:20,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 05:49:20,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:20,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:20,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:20,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 05:49:20,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:20,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:20,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:49:20,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:49:20,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:20,745 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:49:20,745 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:49:20,748 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:20,751 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:20,821 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 05:49:20,821 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:20,831 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:49:20,890 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11524.seqid, newMaxSeqId=11524, maxSeqId=11523 2018-05-02 05:49:20,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11524 2018-05-02 05:49:20,916 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:49:20,920 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:49:20,921 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:21,005 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:49:21,395 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:49:21,396 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:49:21,528 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:49:21,528 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:49:21,528 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:49:21,539 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:49:21,549 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:49:21,549 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:49:22,105 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:49:22,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 6cfc24cc3a423e0969138ce2a69be99e, NAME => 'test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 05:49:22,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AuthenticationService 2018-05-02 05:49:22,125 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:22,125 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=SecureBulkLoadService 2018-05-02 05:49:22,125 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:22,125 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:22,125 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:22,125 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AccessControlService 2018-05-02 05:49:22,125 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:22,125 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:22,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 05:49:22,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:49:22,126 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:22,143 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 05:49:22,143 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 05:49:22,144 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:22,144 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:22,175 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf/cd508c6396b04928b56ea073a30af8a5 2018-05-02 05:49:22,175 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:22,184 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 05:49:22,218 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12236.seqid, newMaxSeqId=12236, maxSeqId=12235 2018-05-02 05:49:22,225 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 6cfc24cc3a423e0969138ce2a69be99e; next sequenceid=12236 2018-05-02 05:49:22,230 INFO [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:49:22,233 DEBUG [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 05:49:22,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:23,301 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:49:23,316 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 5c3fc4872d744c7bdc4c539ee55dc094, NAME => 'test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:49:23,316 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AuthenticationService 2018-05-02 05:49:23,316 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:23,316 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=SecureBulkLoadService 2018-05-02 05:49:23,317 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:23,317 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:23,317 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:23,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AccessControlService 2018-05-02 05:49:23,317 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:23,317 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:23,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 05:49:23,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:49:23,317 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:23,346 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 05:49:23,346 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 05:49:23,347 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:23,347 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:23,761 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf/f50a0196e806447fb2330bc9b1168573 2018-05-02 05:49:23,761 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:23,773 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 05:49:23,783 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294165ms 2018-05-02 05:49:23,818 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12188.seqid, newMaxSeqId=12188, maxSeqId=12187 2018-05-02 05:49:23,826 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 5c3fc4872d744c7bdc4c539ee55dc094; next sequenceid=12188 2018-05-02 05:49:23,828 INFO [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:49:23,832 DEBUG [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 05:49:23,832 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:25,689 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:49:25,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:49:25,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 05:49:25,706 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:25,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 05:49:25,706 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:25,706 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:25,707 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:25,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 05:49:25,707 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:25,707 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:25,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:49:25,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:49:25,707 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:25,714 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:49:25,715 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:49:25,716 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:49:25,952 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:49:25,952 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:49:25,953 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:25,953 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:26,221 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:49:26,359 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 05:49:26,359 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:26,372 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:49:26,417 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12714.seqid, newMaxSeqId=12714, maxSeqId=12713 2018-05-02 05:49:26,426 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=12714 2018-05-02 05:49:26,428 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:49:26,432 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:49:26,432 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:26,490 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:49:26,490 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:49:26,543 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:49:26,543 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:49:26,543 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:49:26,547 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:49:26,549 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:49:26,549 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:49:28,265 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 117 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:49:28,304 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:49:28,917 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:49:28,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:49:28,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 05:49:28,918 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:28,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 05:49:28,918 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:28,918 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:28,918 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:28,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 05:49:28,918 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:28,919 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:28,919 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:49:28,919 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:49:28,919 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:28,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:49:28,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:49:28,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:28,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:49:28,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:28,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:28,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:28,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:49:28,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:28,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:28,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:49:28,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:49:28,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:28,951 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:49:28,951 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:49:28,952 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:28,952 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:28,955 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:49:28,955 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:49:28,956 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:28,956 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:28,991 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 05:49:28,991 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:28,994 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:49:28,995 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:29,003 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:49:29,005 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:49:29,050 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13220.seqid, newMaxSeqId=13220, maxSeqId=13219 2018-05-02 05:49:29,055 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12792.seqid, newMaxSeqId=12792, maxSeqId=12791 2018-05-02 05:49:29,060 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13220 2018-05-02 05:49:29,066 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12792 2018-05-02 05:49:29,075 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:49:29,075 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:49:29,082 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:49:29,082 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:29,084 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:49:29,084 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:29,692 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:49:29,701 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:49:29,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 05:49:29,702 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:29,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 05:49:29,702 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:29,702 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:29,702 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:29,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 05:49:29,703 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:29,703 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:29,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:49:29,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:49:29,703 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:29,719 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:49:29,719 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:49:29,720 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=809, currentSize=50.86 MB, freeSize=153.94 MB, maxSize=204.80 MB, heapSize=50.86 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:29,721 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:29,750 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 05:49:29,750 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:29,757 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:49:29,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12992.seqid, newMaxSeqId=12992, maxSeqId=12991 2018-05-02 05:49:29,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=12992 2018-05-02 05:49:29,792 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:49:29,795 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:49:29,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 05:49:30,221 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2." 2018-05-02 05:49:30,222 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close bb80fda45cdcaf338a2a3cfb863adfc2, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.61.83 2018-05-02 05:49:30,224 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:30,224 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 05:49:30,225 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:49:30,258 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12764.seqid, newMaxSeqId=12764, maxSeqId=12762 2018-05-02 05:49:30,265 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:49:30,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:49:30,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:49:30,267 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:49:30,267 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding bb80fda45cdcaf338a2a3cfb863adfc2 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12762 2018-05-02 05:49:30,271 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:49:30,710 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:49:30,713 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:49:30,713 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:49:31,228 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:49:31,753 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:49:31,753 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:49:31,864 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:49:31,864 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:49:31,864 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:49:31,876 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:49:31,879 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:49:31,879 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:49:32,023 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:32,024 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:32,024 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:32,042 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:32,044 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:32,044 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:32,944 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25391ms 2018-05-02 05:49:35,061 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.008 minutes, events=7, succcessCount=7, totalEvents=81348, totalSuccessCount=81348 2018-05-02 05:49:40,521 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:40,521 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:40,521 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:40,535 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:40,537 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:40,541 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:41,382 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:41,382 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:41,382 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:41,393 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:41,394 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:41,394 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:43,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154139ms 2018-05-02 05:49:43,819 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:43,819 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:43,819 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:43,844 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:43,845 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:43,846 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468740 bytes) of f1 2018-05-02 05:49:46,603 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:46,603 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:46,604 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:46,627 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:46,628 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:46,629 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:47,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468692 bytes) of f1 2018-05-02 05:49:47,436 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:47,436 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:47,436 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:47,453 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:47,455 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:47,455 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:48,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468674 bytes) of f1 2018-05-02 05:49:50,094 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.039 minutes, events=20, succcessCount=10, totalEvents=673271, totalSuccessCount=81353 2018-05-02 05:49:53,517 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19547ms 2018-05-02 05:50:02,446 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:02,447 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:02,447 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:02,459 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:02,460 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:02,460 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:03,758 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48788ms 2018-05-02 05:50:12,915 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165873ms 2018-05-02 05:50:14,029 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:14,029 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:14,029 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:14,050 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:14,052 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:14,052 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:14,535 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:14,535 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:14,535 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:14,548 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:14,549 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:14,551 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:19,797 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:19,797 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:19,797 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:19,813 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:19,815 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:19,815 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:22,939 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43726ms 2018-05-02 05:50:27,244 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:27,244 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:27,244 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:27,262 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:27,263 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:27,264 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:32,743 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:32,743 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:32,743 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:32,766 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:32,767 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:32,768 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:32,969 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43225ms 2018-05-02 05:50:42,917 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221244ms 2018-05-02 05:50:45,696 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:45,696 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:45,697 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:45,726 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:45,728 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:45,728 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:48,557 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:48,557 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:48,557 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:48,570 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:48,596 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:48,597 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:49,382 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:49,382 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:49,382 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:49,403 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:49,404 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:49,409 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:50:53,088 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:02.994 minutes, events=2, succcessCount=1, totalEvents=673273, totalSuccessCount=81354 2018-05-02 05:50:53,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163281ms 2018-05-02 05:50:59,070 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:50:59,070 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:59,070 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:50:59,086 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:50:59,089 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:50:59,090 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:51:02,924 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197755ms 2018-05-02 05:51:08,158 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:51:08,158 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:08,158 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:51:08,170 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:08,171 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:51:08,171 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:51:10,880 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:51:10,881 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:10,881 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:51:10,900 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:10,901 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:51:10,902 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:51:13,363 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86551ms 2018-05-02 05:51:16,109 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:51:16,109 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:16,109 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:51:16,138 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:16,139 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:51:16,140 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:51:22,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37347ms 2018-05-02 05:51:25,893 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:51:25,893 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:25,893 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:51:25,910 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:25,911 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:51:25,912 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:51:28,115 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:51:28,116 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:28,116 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:51:28,129 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:51:28,130 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:51:28,130 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:51:32,931 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23842ms 2018-05-02 05:51:43,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106210ms 2018-05-02 05:51:44,067 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=51.01 MB, freeSize=153.79 MB, max=204.80 MB, blockCount=827, accesses=1441, hits=577, hitRatio=40.04%, , cachingAccesses=1408, cachingHits=577, cachingHitsRatio=40.98%, evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:51:52,915 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275787ms 2018-05-02 05:51:53,093 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=7, created chunk count=58, reused chunk count=21, reuseRatio=26.58% 2018-05-02 05:51:53,105 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:52:02,927 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 66303ms 2018-05-02 05:52:12,930 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217189ms 2018-05-02 05:52:23,458 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86039ms 2018-05-02 05:52:32,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130901ms 2018-05-02 05:52:43,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237101ms 2018-05-02 05:52:53,835 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228100ms 2018-05-02 05:53:02,958 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208278ms 2018-05-02 05:53:12,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217965ms 2018-05-02 05:53:23,277 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155134ms 2018-05-02 05:53:33,050 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269976ms 2018-05-02 05:53:42,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101629ms 2018-05-02 05:53:53,733 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124021ms 2018-05-02 05:54:02,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287487ms 2018-05-02 05:54:08,496 DEBUG [RS-EventLoopGroup-1-62] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:54:08,498 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:54:08,498 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:54:08,500 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:54:08,501 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:54:08,502 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:54:08,504 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:54:08,505 DEBUG [RS-EventLoopGroup-1-62] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:54:08,505 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:54:13,578 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197386ms 2018-05-02 05:54:17,950 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:54:17,951 DEBUG [MemStoreFlusher.1] regionserver.FlushAllLargeStoresPolicy: Since none of the CFs were above the size, flushing all. 2018-05-02 05:54:17,951 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 2/2 column families, memstore data size=143.14 KB memstore heap size=210.42 KB 2018-05-02 05:54:18,097 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=143.02 KB at sequenceid=1102 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/c6ad95e9f971467bbf9f313e12bfa7d2 2018-05-02 05:54:18,192 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=124 B at sequenceid=1102 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/46833e5ddfa54d65980187d808356d45 2018-05-02 05:54:18,216 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/c6ad95e9f971467bbf9f313e12bfa7d2 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c6ad95e9f971467bbf9f313e12bfa7d2 2018-05-02 05:54:18,238 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c6ad95e9f971467bbf9f313e12bfa7d2, entries=810, sequenceid=1102, filesize=136.9 K 2018-05-02 05:54:18,242 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/46833e5ddfa54d65980187d808356d45 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/46833e5ddfa54d65980187d808356d45 2018-05-02 05:54:18,266 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/46833e5ddfa54d65980187d808356d45, entries=2, sequenceid=1102, filesize=4.7 K 2018-05-02 05:54:18,269 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~143.14 KB/146575, heap size ~211.05 KB/216120, currentsize=0 B/0 for 1588230740 in 318ms, sequenceid=1102, compaction requested=true 2018-05-02 05:54:18,269 DEBUG [MemStoreFlusher.1] regionserver.CompactSplit: Small Compaction requested: system; Because: MemStoreFlusher.1; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2018-05-02 05:54:18,269 DEBUG [MemStoreFlusher.1] regionserver.CompactSplit: Small Compaction requested: system; Because: MemStoreFlusher.1; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 05:54:18,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:54:18,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:54:18,270 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 05:54:18,270 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.SortedCompactionPolicy: Selecting compaction from 2 store files, 0 compacting, 2 eligible, 10 blocking 2018-05-02 05:54:18,274 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store hbase:meta,,1.1588230740; time since last major compaction 601057ms 2018-05-02 05:54:18,275 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store hbase:meta,,1.1588230740; time since last major compaction 2312208ms 2018-05-02 05:54:18,275 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HStore: 1588230740 - info: Initiating major compaction (all files) 2018-05-02 05:54:18,275 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] regionserver.HStore: 1588230740 - table: Initiating major compaction (all files) 2018-05-02 05:54:18,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HRegion: Starting compaction of info in hbase:meta,,1.1588230740 2018-05-02 05:54:18,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] regionserver.HRegion: Starting compaction of table in hbase:meta,,1.1588230740 2018-05-02 05:54:18,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/599402593583420685669c3336944659, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c6ad95e9f971467bbf9f313e12bfa7d2] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=300.0 K 2018-05-02 05:54:18,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/8b64c97177a74d56bbb40fc595fa8fb4, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/46833e5ddfa54d65980187d808356d45] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=14.7 K 2018-05-02 05:54:18,277 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.Compactor: Compacting 599402593583420685669c3336944659, keycount=972, bloomtype=NONE, size=163.1 K, encoding=NONE, seqNum=863, earliestPutTs=1525237873075 2018-05-02 05:54:18,277 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] compactions.Compactor: Compacting 00f6c58a4ce94421b57455b1c3162100, keycount=12, bloomtype=NONE, size=5.2 K, encoding=NONE, seqNum=231, earliestPutTs=1525237102016 2018-05-02 05:54:18,278 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] compactions.Compactor: Compacting c6ad95e9f971467bbf9f313e12bfa7d2, keycount=810, bloomtype=NONE, size=136.9 K, encoding=NONE, seqNum=1102, earliestPutTs=1525239857808 2018-05-02 05:54:18,278 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] compactions.Compactor: Compacting 8b64c97177a74d56bbb40fc595fa8fb4, keycount=3, bloomtype=NONE, size=4.8 K, encoding=NONE, seqNum=598, earliestPutTs=1525238858937 2018-05-02 05:54:18,280 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] compactions.Compactor: Compacting 46833e5ddfa54d65980187d808356d45, keycount=2, bloomtype=NONE, size=4.7 K, encoding=NONE, seqNum=1102, earliestPutTs=1525239891285 2018-05-02 05:54:18,323 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:54:18,343 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:54:18,361 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] throttle.PressureAwareThroughputController: 1588230740#table#compaction#9 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 10.00 MB/second 2018-05-02 05:54:18,376 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] throttle.PressureAwareThroughputController: 1588230740#info#compaction#8 average throughput is 4.87 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 05:54:18,414 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/b79727d75bb540fcaf5e3b370a19f971 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/b79727d75bb540fcaf5e3b370a19f971 2018-05-02 05:54:18,426 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/2fa8671e8559457caa88f9377b1dca03 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/2fa8671e8559457caa88f9377b1dca03 2018-05-02 05:54:18,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.HStore: Completed major compaction of 2 (all) file(s) in info of 1588230740 into b79727d75bb540fcaf5e3b370a19f971(size=227.5 K), total size for store is 227.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 05:54:18,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=info, priority=8, startTime=1525240458269; duration=0sec 2018-05-02 05:54:18,432 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525239856797] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 05:54:18,458 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] regionserver.HStore: Completed major compaction of 3 (all) file(s) in table of 1588230740 into 2fa8671e8559457caa88f9377b1dca03(size=5.5 K), total size for store is 5.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 05:54:18,459 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=table, priority=7, startTime=1525240458269; duration=0sec 2018-05-02 05:54:18,459 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525239712808] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 05:54:20,116 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=04:45.055 minutes, events=6, succcessCount=6, totalEvents=81354, totalSuccessCount=81354 2018-05-02 05:54:20,490 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:54:20,491 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:54:20,493 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:54:20,999 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:54:21,420 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:54:21,421 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:54:21,516 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:54:21,517 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:54:21,517 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:54:21,525 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:54:21,530 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:54:21,530 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:54:53,137 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.021 minutes, events=6, succcessCount=3, totalEvents=673279, totalSuccessCount=81357 2018-05-02 05:55:30,282 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:55:30,286 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 1 failover attempts. Trying to failover after sleeping for 561ms. 2018-05-02 05:55:30,849 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 2 failover attempts. Trying to failover after sleeping for 2731ms. 2018-05-02 05:55:33,582 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 3 failover attempts. Trying to failover after sleeping for 3948ms. 2018-05-02 05:55:37,533 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 4 failover attempts. Trying to failover after sleeping for 7829ms. 2018-05-02 05:55:45,364 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 5 failover attempts. Trying to failover after sleeping for 22375ms. 2018-05-02 05:55:53,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/599402593583420685669c3336944659, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c6ad95e9f971467bbf9f313e12bfa7d2] to archive 2018-05-02 05:55:53,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/8b64c97177a74d56bbb40fc595fa8fb4, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/46833e5ddfa54d65980187d808356d45] to archive 2018-05-02 05:55:53,768 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 05:55:53,768 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 05:55:53,768 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: A failover has occurred since the start of call #908 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 2018-05-02 05:55:53,769 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 931ms. 2018-05-02 05:55:53,770 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 1326ms. 2018-05-02 05:55:54,703 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 1840ms. 2018-05-02 05:55:55,096 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: A failover has occurred since the start of call #908 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 05:55:55,099 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 1194ms. 2018-05-02 05:55:56,295 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 2169ms. 2018-05-02 05:55:56,543 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: A failover has occurred since the start of call #909 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 2018-05-02 05:55:56,545 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 4086ms. 2018-05-02 05:55:58,466 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 11498ms. 2018-05-02 05:56:00,632 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: A failover has occurred since the start of call #909 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 05:56:00,635 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 10674ms. 2018-05-02 05:56:07,739 WARN [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: A failover has occurred since the start of call #907 ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 05:56:07,742 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 18415ms. 2018-05-02 05:56:09,966 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 12073ms. 2018-05-02 05:56:11,309 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: A failover has occurred since the start of call #909 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 2018-05-02 05:56:11,312 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 15167ms. 2018-05-02 05:56:22,042 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 11926ms. 2018-05-02 05:56:26,157 WARN [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: A failover has occurred since the start of call #907 ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 05:56:26,159 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 7 failover attempts. Trying to failover after sleeping for 19604ms. 2018-05-02 05:56:26,479 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: A failover has occurred since the start of call #909 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 05:56:26,482 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 18445ms. 2018-05-02 05:56:36,562 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3126) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 13466ms. 2018-05-02 05:56:44,067 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=50.85 MB, freeSize=153.95 MB, max=204.80 MB, blockCount=805, accesses=1503, hits=621, hitRatio=41.32%, , cachingAccesses=1430, cachingHits=599, cachingHitsRatio=41.89%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 05:56:44,927 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: A failover has occurred since the start of call #909 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 2018-05-02 05:56:44,931 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3126) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 21805ms. 2018-05-02 05:56:45,764 WARN [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: A failover has occurred since the start of call #907 ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 2018-05-02 05:56:45,769 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Trying to failover after sleeping for 12918ms. 2018-05-02 05:56:50,047 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/info. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/info. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Retrying after sleeping for 7780ms. 2018-05-02 05:56:53,093 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=9, created chunk count=58, reused chunk count=21, reuseRatio=26.58% 2018-05-02 05:56:53,104 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:56:57,832 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/info. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/info. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Retrying after sleeping for 14549ms. 2018-05-02 05:56:58,687 WARN [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: A failover has occurred since the start of call #907 ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 05:56:58,692 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1347766793_1. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1347766793_1. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Retrying after sleeping for 9049ms. 2018-05-02 05:57:06,736 WARN [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: A failover has occurred since the start of call #909 ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 05:57:06,740 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/table. Name node is in safe mode. The reported blocks 329 needs additional 68 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/table. Name node is in safe mode. The reported blocks 329 needs additional 68 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Retrying after sleeping for 11076ms. 2018-05-02 05:57:07,745 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1347766793_1. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1347766793_1. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Retrying after sleeping for 15066ms. 2018-05-02 05:57:12,385 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/info. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/info. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Retrying after sleeping for 12150ms. 2018-05-02 05:57:17,821 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/table. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3131) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1126) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:705) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /apps/hbase/data/archive/data/hbase/meta/1588230740/table. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.mkdirs over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Retrying after sleeping for 7632ms. 2018-05-02 05:57:22,821 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1347766793_1. Name node is in safe mode. The reported blocks 397 has reached the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1347766793_1. Name node is in safe mode. The reported blocks 397 has reached the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Retrying after sleeping for 12582ms. 2018-05-02 05:57:24,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] backup.HFileArchiver: Archiving compacted files. 2018-05-02 05:57:24,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/599402593583420685669c3336944659 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/599402593583420685669c3336944659 2018-05-02 05:57:24,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/c6ad95e9f971467bbf9f313e12bfa7d2 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/c6ad95e9f971467bbf9f313e12bfa7d2 2018-05-02 05:57:25,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] backup.HFileArchiver: Archiving compacted files. 2018-05-02 05:57:25,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100 2018-05-02 05:57:25,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/8b64c97177a74d56bbb40fc595fa8fb4 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/table/8b64c97177a74d56bbb40fc595fa8fb4 2018-05-02 05:57:25,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/46833e5ddfa54d65980187d808356d45 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/table/46833e5ddfa54d65980187d808356d45 2018-05-02 05:59:08,491 DEBUG [RS-EventLoopGroup-1-63] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 05:59:08,493 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:59:08,493 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:59:08,498 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:59:08,500 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:59:08,500 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:59:08,502 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:59:08,503 DEBUG [RS-EventLoopGroup-1-63] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:59:08,503 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:59:20,490 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:59:20,491 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:59:20,493 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:59:21,001 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:59:21,359 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:59:21,359 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 05:59:21,661 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 05:59:21,661 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:59:21,661 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:59:21,674 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:59:21,679 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:59:21,679 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:00:54,291 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:01:44,067 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=51.08 MB, freeSize=153.72 MB, max=204.80 MB, blockCount=834, accesses=1532, hits=621, hitRatio=40.54%, , cachingAccesses=1459, cachingHits=599, cachingHitsRatio=41.06%, evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 06:01:47,254 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 2018-05-02 06:01:47,257 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 znode expired, triggering replicatorRemoved event 2018-05-02 06:01:47,258 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:01:47,454 DEBUG [RS-EventLoopGroup-1-64] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,455 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:01:47,455 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,456 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:01:47,458 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,458 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:01:47,459 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,459 DEBUG [RS-EventLoopGroup-1-64] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,459 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:01:47,881 DEBUG [RS-EventLoopGroup-1-1] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,882 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:01:47,882 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,884 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:01:47,885 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,885 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:01:47,886 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,886 DEBUG [RS-EventLoopGroup-1-1] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,886 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:01:47,888 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:01:47,904 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:01:47,905 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 166b9a4d8133a32343e23907c3228d62, NAME => 'test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:01:47,905 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 735c68afadbe039ceafe7e37c71a82b8, NAME => 'test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:01:47,905 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 8cb8f1e8202d0fae01b5300bd7c59bcb, NAME => 'test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 93f2d602c0a0a654856fb16863c2ff38, NAME => 'test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AuthenticationService 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AuthenticationService 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AuthenticationService 2018-05-02 06:01:47,905 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,905 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,905 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=SecureBulkLoadService 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=SecureBulkLoadService 2018-05-02 06:01:47,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AuthenticationService 2018-05-02 06:01:47,906 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,906 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,108 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AccessControlService 2018-05-02 06:01:48,109 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:01:48,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:01:48,110 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=SecureBulkLoadService 2018-05-02 06:01:48,110 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:48,110 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,110 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,111 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AccessControlService 2018-05-02 06:01:48,111 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,111 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,111 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:01:48,111 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:01:48,112 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:48,106 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:48,100 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:48,113 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=SecureBulkLoadService 2018-05-02 06:01:48,113 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,113 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:48,113 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,113 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,113 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,113 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AccessControlService 2018-05-02 06:01:48,113 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AccessControlService 2018-05-02 06:01:48,113 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,113 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,114 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,113 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,114 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:01:48,114 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:01:48,114 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 166b9a4d8133a32343e23907c3228d62 2018-05-02 06:01:48,114 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:01:48,115 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:48,115 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:48,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => f3ccd3e0671152671071dbba3e2cb560, NAME => 'test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:01:48,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AuthenticationService 2018-05-02 06:01:48,120 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:48,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=SecureBulkLoadService 2018-05-02 06:01:48,121 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:48,121 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,121 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AccessControlService 2018-05-02 06:01:48,121 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,121 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:01:48,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:01:48,122 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:48,131 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:01:48,131 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:01:48,132 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,133 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,150 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:01:48,150 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:01:48,150 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:01:48,150 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:01:48,150 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:01:48,150 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:01:48,151 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,152 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,154 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,154 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,156 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:01:48,156 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:01:48,156 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,157 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,158 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,166 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,239 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 06:01:48,241 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,242 WARN [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #994 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,242 INFO [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,242 WARN [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #993 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,245 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,245 WARN [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #992 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,253 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1/abd14eb0366d49d6b1f9c4e3beb7ea22 2018-05-02 06:01:48,253 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,258 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,258 WARN [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #995 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62 2018-05-02 06:01:48,274 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1/da3881a0cb0542f0a0fdfe2ffd2e6aba 2018-05-02 06:01:48,274 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,277 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/07854b903e5c4a14aab13c9789d93907 2018-05-02 06:01:48,278 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf/0a4f5f73439447d58ac2371e0ea69f1f 2018-05-02 06:01:48,279 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,282 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/3f2d2f80200b4e7086e08019eff91a27 2018-05-02 06:01:48,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:01:48,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:01:48,318 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/4fedc898e84f4979967e3b8666fea966 2018-05-02 06:01:48,319 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:01:48,333 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/d9d7b3335aed4b73b1949214243017d7 2018-05-02 06:01:48,334 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,336 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 166b9a4d8133a32343e23907c3228d62; next sequenceid=408 2018-05-02 06:01:48,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:01:48,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:01:48,349 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:01:48,350 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 93f2d602c0a0a654856fb16863c2ff38; next sequenceid=408 2018-05-02 06:01:48,354 INFO [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:01:48,357 DEBUG [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:01:48,359 INFO [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:01:48,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:01:48,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12791.seqid, newMaxSeqId=12791, maxSeqId=12790 2018-05-02 06:01:48,364 DEBUG [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:01:48,364 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:01:48,373 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened f3ccd3e0671152671071dbba3e2cb560; next sequenceid=12791 2018-05-02 06:01:48,388 INFO [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:01:48,392 DEBUG [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:01:48,393 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:01:48,413 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:01:48,419 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:01:48,443 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 735c68afadbe039ceafe7e37c71a82b8; next sequenceid=411 2018-05-02 06:01:48,444 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 8cb8f1e8202d0fae01b5300bd7c59bcb; next sequenceid=411 2018-05-02 06:01:48,445 INFO [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:01:48,451 DEBUG [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:01:48,452 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:01:48,455 INFO [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:01:48,460 DEBUG [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:01:48,460 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:01:50,176 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=07:30.060 minutes, events=3, succcessCount=3, totalEvents=81357, totalSuccessCount=81357 2018-05-02 06:01:53,093 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=8, created chunk count=58, reused chunk count=22, reuseRatio=27.50% 2018-05-02 06:01:53,104 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:01:53,110 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:01:53,111 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:01:53,113 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:01:53,177 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=4, succcessCount=2, totalEvents=673283, totalSuccessCount=81359 2018-05-02 06:01:53,618 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:01:53,867 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:01:53,867 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:01:54,056 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:01:54,056 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:01:54,056 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:01:54,064 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:01:54,066 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:01:54,066 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:02:28,246 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:03:22,977 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,978 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:03:22,981 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,984 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Claimed the leader znode as 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656' 2018-05-02 06:03:22,984 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,992 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:03:22,997 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 1 2018-05-02 06:03:22,997 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 2 2018-05-02 06:03:22,997 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 3 2018-05-02 06:03:22,999 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 4 2018-05-02 06:03:22,999 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 5 2018-05-02 06:03:22,999 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 6 2018-05-02 06:03:23,000 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/5 2018-05-02 06:03:23,003 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 5 2018-05-02 06:03:23,006 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 2018-05-02 06:03:23,015 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 znode expired, triggering replicatorRemoved event 2018-05-02 06:03:23,016 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:03:23,590 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:03:23,612 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:03:23,612 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:03:23,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 47c574242e461d8e7a12972718bc27ff, NAME => 'test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:03:23,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AuthenticationService 2018-05-02 06:03:23,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 25414d6e395eadb383c40973693beb12, NAME => 'test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:03:23,614 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=SecureBulkLoadService 2018-05-02 06:03:23,614 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,614 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,614 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AuthenticationService 2018-05-02 06:03:23,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AccessControlService 2018-05-02 06:03:23,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=SecureBulkLoadService 2018-05-02 06:03:23,615 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,615 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,615 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AccessControlService 2018-05-02 06:03:23,615 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 47c574242e461d8e7a12972718bc27ff 2018-05-02 06:03:23,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:03:23,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 25414d6e395eadb383c40973693beb12 2018-05-02 06:03:23,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:03:23,616 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,616 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,651 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:03:23,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:03:23,653 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:03:23,653 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:03:23,654 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 06:03:23,654 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,654 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,655 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,660 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 06:03:23,661 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,661 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,661 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 06:03:23,661 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,661 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:03:23,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:03:23,662 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,669 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:03:23,669 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:03:23,670 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,671 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,715 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:03:23,715 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:03:23,715 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:03:23,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 5bd8c2cd29520d0d27cacb48e7436a6d, NAME => 'test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:03:23,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AuthenticationService 2018-05-02 06:03:23,716 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=SecureBulkLoadService 2018-05-02 06:03:23,716 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,716 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,716 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AccessControlService 2018-05-02 06:03:23,717 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 45aba4505046246827a28b03d1c2611e, NAME => 'test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:03:23,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 06:03:23,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:03:23,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AuthenticationService 2018-05-02 06:03:23,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=SecureBulkLoadService 2018-05-02 06:03:23,718 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,718 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:03:23,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 06:03:23,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AccessControlService 2018-05-02 06:03:23,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 45aba4505046246827a28b03d1c2611e 2018-05-02 06:03:23,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:03:23,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 06:03:23,720 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,720 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,720 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 06:03:23,720 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,720 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:03:23,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:03:23,721 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,748 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:03:23,748 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:03:23,749 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,755 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => b89f4262e34dfdd1fbea3661f9d50263, NAME => 'hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:03:23,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AuthenticationService 2018-05-02 06:03:23,776 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=SecureBulkLoadService 2018-05-02 06:03:23,776 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,776 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,776 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AccessControlService 2018-05-02 06:03:23,776 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,776 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table acl b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:03:23,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:03:23,781 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/210fc8ab70c74f0b94dd06fb92efaddb 2018-05-02 06:03:23,844 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:03:23,844 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:03:23,845 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 06:03:23,845 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 06:03:23,845 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,846 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,846 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,846 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,857 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:03:23,857 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:03:23,860 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,862 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,866 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/bc3bcfcc061c4f8983a05c3b21b4aba4 2018-05-02 06:03:23,897 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:03:23,897 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:03:23,898 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,898 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,902 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:03:23,948 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/d841feb0096c401b9a78e0050ee83d68 2018-05-02 06:03:23,948 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,951 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9183f33444af4ba4b0488cd21989a0e1 2018-05-02 06:03:23,997 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf/e3402645d07644fb92ee0b1234e4c0d4 2018-05-02 06:03:23,997 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,007 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12 2018-05-02 06:03:24,015 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/325853d0d9c94cb6ba31e4bcbf47843e 2018-05-02 06:03:24,015 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,017 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 06:03:24,017 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,019 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 06:03:24,019 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,035 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 06:03:24,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:03:24,049 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff 2018-05-02 06:03:24,050 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:03:24,057 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9ca70b0c41a14a7db0a7b4b70bd83580 2018-05-02 06:03:24,057 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,066 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=19 2018-05-02 06:03:24,100 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened b89f4262e34dfdd1fbea3661f9d50263; next sequenceid=20 2018-05-02 06:03:24,109 INFO [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:03:24,121 DEBUG [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Finished post open deploy task for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:03:24,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:03:24,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e 2018-05-02 06:03:24,164 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:03:24,183 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 25414d6e395eadb383c40973693beb12; next sequenceid=411 2018-05-02 06:03:24,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/12875.seqid, newMaxSeqId=12875, maxSeqId=12874 2018-05-02 06:03:24,193 INFO [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:03:24,200 DEBUG [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:03:24,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:03:24,203 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12531.seqid, newMaxSeqId=12531, maxSeqId=12530 2018-05-02 06:03:24,206 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12753.seqid, newMaxSeqId=12753, maxSeqId=12752 2018-05-02 06:03:24,209 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 5bd8c2cd29520d0d27cacb48e7436a6d; next sequenceid=12875 2018-05-02 06:03:24,222 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12531 2018-05-02 06:03:24,223 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12753 2018-05-02 06:03:24,224 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:03:24,227 INFO [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:03:24,229 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:03:24,231 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 47c574242e461d8e7a12972718bc27ff; next sequenceid=411 2018-05-02 06:03:24,233 DEBUG [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:03:24,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:03:24,236 INFO [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:03:24,236 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:03:24,237 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:03:24,242 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 45aba4505046246827a28b03d1c2611e; next sequenceid=414 2018-05-02 06:03:24,249 INFO [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:03:24,256 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:03:24,256 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:03:24,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:03:24,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:03:24,257 DEBUG [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:03:24,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:03:24,259 DEBUG [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:03:24,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:03:24,643 DEBUG [RS-EventLoopGroup-1-2] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:03:24,644 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:03:24,644 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:03:24,645 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:03:24,654 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:03:24,654 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:03:24,667 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:03:24,667 DEBUG [RS-EventLoopGroup-1-2] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:03:24,667 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:03:24,890 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:03:24,891 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:03:24,891 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:03:24,893 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:03:24,898 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:03:24,899 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:03:24,903 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:03:24,903 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:03:24,903 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:03:28,616 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:03:28,617 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:03:28,619 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:03:29,123 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:03:29,185 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:39.009 minutes, events=2, succcessCount=2, totalEvents=81359, totalSuccessCount=81359 2018-05-02 06:03:29,500 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:03:29,501 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:03:29,622 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:03:29,622 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:03:29,622 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:03:29,630 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:03:29,632 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:03:29,632 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:03:30,101 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:03:53,186 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=6, succcessCount=3, totalEvents=673289, totalSuccessCount=81362 2018-05-02 06:03:57,562 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:04:13,260 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:04:13,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => cb06832d0afac8a9bdbe1f92ad565ab6, NAME => 'test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:04:13,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AuthenticationService 2018-05-02 06:04:13,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:13,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=SecureBulkLoadService 2018-05-02 06:04:13,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:13,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:13,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:13,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AccessControlService 2018-05-02 06:04:13,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:13,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:13,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 06:04:13,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:04:13,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:13,294 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 06:04:13,295 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 06:04:13,295 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:13,296 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:13,320 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2 2018-05-02 06:04:13,321 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:13,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 06:04:13,348 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12882.seqid, newMaxSeqId=12882, maxSeqId=12881 2018-05-02 06:04:13,353 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened cb06832d0afac8a9bdbe1f92ad565ab6; next sequenceid=12882 2018-05-02 06:04:13,355 INFO [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:04:13,358 DEBUG [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:04:13,358 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:04:18,282 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:18,282 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:18,285 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:18,789 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:19,263 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:19,264 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:04:19,490 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:04:19,490 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:19,490 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:19,501 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:19,503 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:19,503 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:22,461 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\257(k\312\032\362\206\244,1525239890069.45aba4505046246827a28b03d1c2611e." 2018-05-02 06:04:22,461 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 45aba4505046246827a28b03d1c2611e, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:22,462 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\377\377\377\377\377\377\377\377,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc." 2018-05-02 06:04:22,462 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 36261edb1d6e5ae1d91cf96e60680ebc, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:22,463 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:22,463 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 45aba4505046246827a28b03d1c2611e, disabling compactions & flushes 2018-05-02 06:04:22,463 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:04:22,463 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:22,463 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 36261edb1d6e5ae1d91cf96e60680ebc, disabling compactions & flushes 2018-05-02 06:04:22,464 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:04:22,500 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 06:04:22,503 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:04:22,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:22,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:22,505 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:22,505 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:04:22,505 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding 36261edb1d6e5ae1d91cf96e60680ebc move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=2 2018-05-02 06:04:22,512 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:22,512 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:22,513 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:22,514 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:04:22,514 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 45aba4505046246827a28b03d1c2611e move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=414 2018-05-02 06:04:22,520 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:04:22,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:04:23,394 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\177\377\377\377\377\377\377\356,1525239890069.25414d6e395eadb383c40973693beb12." 2018-05-02 06:04:23,394 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 25414d6e395eadb383c40973693beb12, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:23,395 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,!\257(k\312\032\362\202,1525239890069.5fc7cfd582bc270c530fe9787011078c." 2018-05-02 06:04:23,395 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 5fc7cfd582bc270c530fe9787011078c, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:23,396 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:23,396 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 25414d6e395eadb383c40973693beb12, disabling compactions & flushes 2018-05-02 06:04:23,396 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:04:23,397 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:23,397 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 5fc7cfd582bc270c530fe9787011078c, disabling compactions & flushes 2018-05-02 06:04:23,397 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:04:23,397 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.03 MB memstore heap size=4.26 MB 2018-05-02 06:04:23,482 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:04:23,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:23,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:23,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:23,490 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:04:23,490 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 25414d6e395eadb383c40973693beb12 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=411 2018-05-02 06:04:23,496 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:04:23,723 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.03 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/.tmp/f1/94cb8f2a93da4c488fdc446518fd1cc5 2018-05-02 06:04:23,775 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/.tmp/f1/94cb8f2a93da4c488fdc446518fd1cc5 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/94cb8f2a93da4c488fdc446518fd1cc5 2018-05-02 06:04:23,811 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/94cb8f2a93da4c488fdc446518fd1cc5, entries=32925, sequenceid=407, filesize=2.0 M 2018-05-02 06:04:23,817 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~2.03 MB/2131632, heap size ~4.26 MB/4467168, currentsize=0 B/0 for 5fc7cfd582bc270c530fe9787011078c in 420ms, sequenceid=407, compaction requested=false 2018-05-02 06:04:23,851 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:04:23,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:23,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:23,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:23,859 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:04:23,859 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 5fc7cfd582bc270c530fe9787011078c move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=407 2018-05-02 06:04:23,864 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:04:24,844 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2." 2018-05-02 06:04:24,844 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close aa977fc80ff408457e9257d2ab7afdf2, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:24,845 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c." 2018-05-02 06:04:24,845 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 84c55bda386b9aa62a8b4df75ca9b38c, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:24,845 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:24,845 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 06:04:24,845 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:04:24,846 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:24,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 84c55bda386b9aa62a8b4df75ca9b38c, disabling compactions & flushes 2018-05-02 06:04:24,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:04:24,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11880.seqid, newMaxSeqId=11880, maxSeqId=11878 2018-05-02 06:04:24,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12533.seqid, newMaxSeqId=12533, maxSeqId=12531 2018-05-02 06:04:24,873 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:24,873 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:24,873 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:24,873 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:04:24,873 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 84c55bda386b9aa62a8b4df75ca9b38c move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=11878 2018-05-02 06:04:24,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:24,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:24,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:24,875 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:04:24,876 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:04:24,877 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding aa977fc80ff408457e9257d2ab7afdf2 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=12531 2018-05-02 06:04:24,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:04:25,781 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d." 2018-05-02 06:04:25,781 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 5bd8c2cd29520d0d27cacb48e7436a6d, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:25,781 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\ryC^P\327\2244,1525239890069.93f2d602c0a0a654856fb16863c2ff38." 2018-05-02 06:04:25,782 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 93f2d602c0a0a654856fb16863c2ff38, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:25,782 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:25,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 5bd8c2cd29520d0d27cacb48e7436a6d, disabling compactions & flushes 2018-05-02 06:04:25,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:04:25,782 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:25,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 93f2d602c0a0a654856fb16863c2ff38, disabling compactions & flushes 2018-05-02 06:04:25,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:04:25,801 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:04:25,804 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/12877.seqid, newMaxSeqId=12877, maxSeqId=12875 2018-05-02 06:04:25,808 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:25,808 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:25,808 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:25,808 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:04:25,808 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 93f2d602c0a0a654856fb16863c2ff38 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=408 2018-05-02 06:04:25,810 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:25,810 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:25,810 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:25,810 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:04:25,811 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 5bd8c2cd29520d0d27cacb48e7436a6d move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12875 2018-05-02 06:04:25,814 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:04:25,814 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:04:26,031 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560." 2018-05-02 06:04:26,031 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close f3ccd3e0671152671071dbba3e2cb560, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:26,032 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844." 2018-05-02 06:04:26,032 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 931a5308337d39ab8fcac37d3a5e5844, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:26,032 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:26,032 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:26,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing f3ccd3e0671152671071dbba3e2cb560, disabling compactions & flushes 2018-05-02 06:04:26,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:04:26,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 06:04:26,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:04:26,057 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12793.seqid, newMaxSeqId=12793, maxSeqId=12791 2018-05-02 06:04:26,060 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12455.seqid, newMaxSeqId=12455, maxSeqId=12453 2018-05-02 06:04:26,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:26,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:26,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:26,064 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:04:26,064 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding f3ccd3e0671152671071dbba3e2cb560 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=12791 2018-05-02 06:04:26,067 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:26,067 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:26,067 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:26,068 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:04:26,068 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 931a5308337d39ab8fcac37d3a5e5844 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12453 2018-05-02 06:04:26,068 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:04:26,075 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:04:26,845 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b." 2018-05-02 06:04:26,845 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 9c38689b653a37956f2ae7364b126f1b, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:26,845 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\206\274\241\257(k\312\b,1525239890069.ab4e529620b9089675ab2d6f3446a39c." 2018-05-02 06:04:26,845 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close ab4e529620b9089675ab2d6f3446a39c, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:26,846 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:26,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 06:04:26,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:04:26,846 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:26,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing ab4e529620b9089675ab2d6f3446a39c, disabling compactions & flushes 2018-05-02 06:04:26,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:04:26,846 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=4.02 MB memstore heap size=8.44 MB 2018-05-02 06:04:26,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12755.seqid, newMaxSeqId=12755, maxSeqId=12753 2018-05-02 06:04:26,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:26,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:26,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:26,884 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:04:26,884 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 9c38689b653a37956f2ae7364b126f1b move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12753 2018-05-02 06:04:26,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:04:27,098 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=4.02 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/.tmp/f1/fbf50f6c80344b5190d76c6ce3b8f375 2018-05-02 06:04:27,132 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/.tmp/f1/fbf50f6c80344b5190d76c6ce3b8f375 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/fbf50f6c80344b5190d76c6ce3b8f375 2018-05-02 06:04:27,157 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/fbf50f6c80344b5190d76c6ce3b8f375, entries=65209, sequenceid=407, filesize=4.0 M 2018-05-02 06:04:27,159 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~4.02 MB/4219248, heap size ~8.44 MB/8847168, currentsize=0 B/0 for ab4e529620b9089675ab2d6f3446a39c in 313ms, sequenceid=407, compaction requested=false 2018-05-02 06:04:27,180 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:04:27,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:27,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:27,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:27,187 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:04:27,187 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding ab4e529620b9089675ab2d6f3446a39c move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=407 2018-05-02 06:04:27,190 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:04:27,505 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:27,506 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:27,508 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:28,012 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:28,258 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:28,259 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:04:28,375 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:04:28,375 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:28,375 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:28,382 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:28,384 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:28,384 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:28,385 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62." 2018-05-02 06:04:28,385 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 665f3f34ec072c60acee3dc78af73b62, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:28,385 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263." 2018-05-02 06:04:28,385 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close b89f4262e34dfdd1fbea3661f9d50263, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:28,386 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:28,386 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:28,386 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 06:04:28,386 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b89f4262e34dfdd1fbea3661f9d50263, disabling compactions & flushes 2018-05-02 06:04:28,386 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:04:28,386 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:04:28,409 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12994.seqid, newMaxSeqId=12994, maxSeqId=12992 2018-05-02 06:04:28,410 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/22.seqid, newMaxSeqId=22, maxSeqId=20 2018-05-02 06:04:28,416 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:28,416 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:28,416 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:28,416 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:04:28,416 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 665f3f34ec072c60acee3dc78af73b62 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=12992 2018-05-02 06:04:28,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:28,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:28,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:28,419 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:04:28,419 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding b89f4262e34dfdd1fbea3661f9d50263 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=20 2018-05-02 06:04:28,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:04:28,424 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:04:29,187 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=6, succcessCount=6, totalEvents=81365, totalSuccessCount=81365 2018-05-02 06:04:29,302 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\274\241\257(k\312\032\330,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8." 2018-05-02 06:04:29,302 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 3b0ff50ae790418c1d7b36d704a3c7a8, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:29,303 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,J\032\362\206\274\241\257\036,1525239890069.47c574242e461d8e7a12972718bc27ff." 2018-05-02 06:04:29,303 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:29,303 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 47c574242e461d8e7a12972718bc27ff, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:29,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 3b0ff50ae790418c1d7b36d704a3c7a8, disabling compactions & flushes 2018-05-02 06:04:29,303 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Running close preflush of {}3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:04:29,303 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:29,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 47c574242e461d8e7a12972718bc27ff, disabling compactions & flushes 2018-05-02 06:04:29,304 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.40 MB memstore heap size=32.32 MB 2018-05-02 06:04:29,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:04:29,336 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:04:29,341 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:29,342 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:29,342 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:29,342 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:04:29,342 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 47c574242e461d8e7a12972718bc27ff move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=411 2018-05-02 06:04:29,345 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:04:29,779 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.40 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/.tmp/f1/f9a518867ce041a0b9932823647fbc93 2018-05-02 06:04:29,797 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/.tmp/f1/f9a518867ce041a0b9932823647fbc93 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1/f9a518867ce041a0b9932823647fbc93 2018-05-02 06:04:29,816 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1/f9a518867ce041a0b9932823647fbc93, entries=249780, sequenceid=404, filesize=15.2 M 2018-05-02 06:04:29,818 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~15.40 MB/16150048, heap size ~32.32 MB/33887224, currentsize=0 B/0 for 3b0ff50ae790418c1d7b36d704a3c7a8 in 515ms, sequenceid=404, compaction requested=false 2018-05-02 06:04:29,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:04:29,835 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:04:29,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:29,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:29,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:29,839 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:04:29,839 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding 3b0ff50ae790418c1d7b36d704a3c7a8 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=404 2018-05-02 06:04:29,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:04:30,028 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,yC^P\327\2245\324,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad." 2018-05-02 06:04:30,028 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close d5e9f3919d5e95ad2d6e01e1e16fa8ad, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:30,029 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:30,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing d5e9f3919d5e95ad2d6e01e1e16fa8ad, disabling compactions & flushes 2018-05-02 06:04:30,029 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Running close preflush of {}d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:04:30,030 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.41 MB memstore heap size=32.33 MB 2018-05-02 06:04:30,451 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.41 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/.tmp/f1/b7efbef765ea477fa322e685336bf3fd 2018-05-02 06:04:30,469 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/.tmp/f1/b7efbef765ea477fa322e685336bf3fd as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1/b7efbef765ea477fa322e685336bf3fd 2018-05-02 06:04:30,491 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1/b7efbef765ea477fa322e685336bf3fd, entries=249859, sequenceid=404, filesize=15.2 M 2018-05-02 06:04:30,494 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~15.41 MB/16162272, heap size ~32.33 MB/33898032, currentsize=0 B/0 for d5e9f3919d5e95ad2d6e01e1e16fa8ad in 465ms, sequenceid=404, compaction requested=false 2018-05-02 06:04:30,494 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:04:30,511 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:04:30,514 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:30,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:30,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:30,515 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:04:30,515 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding d5e9f3919d5e95ad2d6e01e1e16fa8ad move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=404 2018-05-02 06:04:30,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:04:31,347 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e." 2018-05-02 06:04:31,347 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 6cfc24cc3a423e0969138ce2a69be99e, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:31,348 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:31,348 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 6cfc24cc3a423e0969138ce2a69be99e, disabling compactions & flushes 2018-05-02 06:04:31,348 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:04:31,373 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12238.seqid, newMaxSeqId=12238, maxSeqId=12236 2018-05-02 06:04:31,377 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:31,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:31,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:31,378 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:04:31,378 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 6cfc24cc3a423e0969138ce2a69be99e move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=12236 2018-05-02 06:04:31,381 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:04:33,416 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:33,417 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:33,419 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:33,923 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:34,243 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:34,244 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:04:34,343 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:04:34,344 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:34,344 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:34,358 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:34,372 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:34,373 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:53,188 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=30, succcessCount=15, totalEvents=673319, totalSuccessCount=81377 2018-05-02 06:04:59,438 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:04:59,440 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 znode expired, triggering replicatorRemoved event 2018-05-02 06:04:59,440 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:04:59,916 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:04:59,931 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:04:59,932 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 06:04:59,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,932 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 06:04:59,932 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,932 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,932 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 06:04:59,932 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:04:59,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:04:59,933 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,934 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:04:59,947 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:04:59,947 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:04:59,947 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:04:59,948 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:04:59,948 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:04:59,948 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:04:59,948 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:59,948 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 06:04:59,948 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,948 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 06:04:59,948 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,948 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,948 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,949 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 06:04:59,949 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,949 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,949 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:59,949 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:04:59,949 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 26d4b78c3c7d2fdea4d32bb21a3ca5fe, NAME => 'test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 06:04:59,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:04:59,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:04:59,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AuthenticationService 2018-05-02 06:04:59,950 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=SecureBulkLoadService 2018-05-02 06:04:59,950 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,950 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 06:04:59,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 06:04:59,951 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,951 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 06:04:59,951 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:04:59,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:04:59,952 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,950 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,955 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,955 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AccessControlService 2018-05-02 06:04:59,956 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,956 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,956 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 06:04:59,956 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:04:59,956 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,968 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:04:59,969 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => a1d694475a6981010a6489a33c4db464, NAME => 'test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:04:59,970 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AuthenticationService 2018-05-02 06:04:59,970 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,970 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=SecureBulkLoadService 2018-05-02 06:04:59,970 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,970 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,970 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,970 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AccessControlService 2018-05-02 06:04:59,970 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,970 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,971 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a1d694475a6981010a6489a33c4db464 2018-05-02 06:04:59,971 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:04:59,971 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:04:59,972 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:04:59,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:04:59,978 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,978 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:04:59,978 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:04:59,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:04:59,979 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:05:00,024 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:05:00,024 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:05:00,025 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:05:00,025 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:05:00,044 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:05:00,045 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:05:00,045 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:05:00,046 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:05:00,046 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 06:05:00,046 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 06:05:00,047 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:05:00,048 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:05:00,048 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:05:00,048 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:05:00,049 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:05:00,049 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:05:00,049 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:05:00,049 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:05:00,050 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=834, currentSize=51.08 MB, freeSize=153.72 MB, maxSize=204.80 MB, heapSize=51.08 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:05:00,052 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:05:00,092 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 06:05:00,098 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,117 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 06:05:00,118 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,132 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 06:05:00,132 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,143 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:05:00,146 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1/329e30ab65dc41c3a17097e18564f58b 2018-05-02 06:05:00,146 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,146 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:05:00,146 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,163 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:05:00,180 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:05:00,197 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:05:00,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464 2018-05-02 06:05:00,201 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf/6a8aa66cb5364117a56e66c694e2a7f7 2018-05-02 06:05:00,201 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,254 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 06:05:00,268 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13467.seqid, newMaxSeqId=13467, maxSeqId=13466 2018-05-02 06:05:00,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11465.seqid, newMaxSeqId=11465, maxSeqId=11464 2018-05-02 06:05:00,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13467 2018-05-02 06:05:00,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12792.seqid, newMaxSeqId=12792, maxSeqId=12791 2018-05-02 06:05:00,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11465 2018-05-02 06:05:00,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12792 2018-05-02 06:05:00,293 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:05:00,293 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:05:00,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:05:00,298 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:05:00,299 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:05:00,303 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=411 2018-05-02 06:05:00,305 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened a1d694475a6981010a6489a33c4db464; next sequenceid=408 2018-05-02 06:05:00,306 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:05:00,314 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:05:00,314 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:05:00,316 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:05:00,320 INFO [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:05:00,323 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:05:00,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:05:00,325 DEBUG [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:05:00,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:05:00,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12410.seqid, newMaxSeqId=12410, maxSeqId=12409 2018-05-02 06:05:00,349 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:05:00,352 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:05:00,352 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:05:00,355 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 26d4b78c3c7d2fdea4d32bb21a3ca5fe; next sequenceid=12410 2018-05-02 06:05:00,367 INFO [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:05:00,372 DEBUG [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:05:00,372 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:05:04,933 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:05:04,937 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:05:04,937 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:05:05,441 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:05:06,009 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:05:06,010 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:05:06,101 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:05:06,101 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:05:06,101 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:05:06,108 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:05:06,111 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:05:06,111 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:05:35,126 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:05:53,192 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=6, succcessCount=3, totalEvents=673325, totalSuccessCount=81380 Wed May 2 06:06:38 UTC 2018 Terminating regionserver 2018-05-02 06:06:38,014 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:06:38,014 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:06:38,015 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:06:38,015 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:06:38,015 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:06:38,015 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:06:38,015 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:06:38,015 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:06:38,016 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:06:38,016 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:06:38,016 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:06:38,016 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:06:38,016 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 06:06:38,016 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:06:38,016 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:06:38,016 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:06:38,016 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:06:38,016 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:06:38,017 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:06:38,017 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:06:38,017 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:06:38,017 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:06:38,017 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:06:38,018 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:06:38,018 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:06:38,018 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:06:38,018 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:06:38,018 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:06:38,018 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656' ***** 2018-05-02 06:06:38,018 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:08.831 minutes, events=15, succcessCount=15, totalEvents=81380, totalSuccessCount=81380 2018-05-02 06:06:38,020 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:06:38,020 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:06:38,020 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,020 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:06:38,021 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,021 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:06:38,021 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:06:38,021 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:06:38,022 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:06:38,022 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 exiting 2018-05-02 06:06:38,074 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:06:38,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:06:38,089 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:06:38,089 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:06:38,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:06:38,093 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:06:38,093 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:06:38,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:06:38,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:06:38,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,095 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,095 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,095 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 06:06:38,095 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 06:06:38,095 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:06:38,095 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:06:38,096 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,097 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,097 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b03e6835fbab67365568f0d2520e68de, disabling compactions & flushes 2018-05-02 06:06:38,097 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Running close preflush of {}b03e6835fbab67365568f0d2520e68de 2018-05-02 06:06:38,097 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.39 MB memstore heap size=32.30 MB 2018-05-02 06:06:38,098 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,121 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,121 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,121 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,122 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,122 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,122 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,128 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,128 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,128 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:06:38,129 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:06:38,130 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x2e18b72d to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:06:38,137 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:06:38,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:06:38,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:06:38,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:06:38,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 25 regions to close 2018-05-02 06:06:38,141 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,141 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 06:06:38,142 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 06:06:38,142 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=185.66 KB memstore heap size=272.60 KB 2018-05-02 06:06:38,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12803.seqid, newMaxSeqId=12803, maxSeqId=12801 2018-05-02 06:06:38,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,155 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:06:38,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:06:38,156 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,156 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing a1d694475a6981010a6489a33c4db464, disabling compactions & flushes 2018-05-02 06:06:38,156 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:06:38,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12794.seqid, newMaxSeqId=12794, maxSeqId=12792 2018-05-02 06:06:38,175 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,175 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,175 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,176 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:06:38,176 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:06:38,177 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 166b9a4d8133a32343e23907c3228d62, disabling compactions & flushes 2018-05-02 06:06:38,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:06:38,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:06:38,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,207 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:06:38,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:06:38,208 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,208 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 5c3fc4872d744c7bdc4c539ee55dc094, disabling compactions & flushes 2018-05-02 06:06:38,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:06:38,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:06:38,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12190.seqid, newMaxSeqId=12190, maxSeqId=12188 2018-05-02 06:06:38,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,246 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:06:38,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:06:38,247 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 7386aea828f5bbf6f2bb9358162092e6, disabling compactions & flushes 2018-05-02 06:06:38,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:06:38,247 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=4.57 MB memstore heap size=9.58 MB 2018-05-02 06:06:38,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,251 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:06:38,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:06:38,252 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,252 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 06:06:38,252 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:06:38,299 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12461.seqid, newMaxSeqId=12461, maxSeqId=12459 2018-05-02 06:06:38,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,308 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,308 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,308 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:06:38,308 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:06:38,308 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,308 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 06:06:38,308 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:06:38,348 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11526.seqid, newMaxSeqId=11526, maxSeqId=11524 2018-05-02 06:06:38,353 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,353 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,353 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,353 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:06:38,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:06:38,354 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 06:06:38,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:06:38,386 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=185.66 KB at sequenceid=1437 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/ccab58085909451891d996ee39baf6b3 2018-05-02 06:06:38,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11989.seqid, newMaxSeqId=11989, maxSeqId=11987 2018-05-02 06:06:38,429 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,429 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,429 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,429 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:06:38,429 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:06:38,429 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,430 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 7b44edd79044515d04eb08298b1e52e9, disabling compactions & flushes 2018-05-02 06:06:38,430 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:06:38,493 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:06:38,498 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/ccab58085909451891d996ee39baf6b3 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ccab58085909451891d996ee39baf6b3 2018-05-02 06:06:38,499 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,499 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,499 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,499 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:06:38,499 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:06:38,500 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,500 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 06:06:38,500 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:06:38,554 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ccab58085909451891d996ee39baf6b3, entries=941, sequenceid=1437, filesize=157.9 K 2018-05-02 06:06:38,559 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12716.seqid, newMaxSeqId=12716, maxSeqId=12714 2018-05-02 06:06:38,562 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~185.66 KB/190120, heap size ~273.45 KB/280008, currentsize=0 B/0 for 1588230740 in 420ms, sequenceid=1437, compaction requested=false 2018-05-02 06:06:38,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,576 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:06:38,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:06:38,577 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,577 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 8cb8f1e8202d0fae01b5300bd7c59bcb, disabling compactions & flushes 2018-05-02 06:06:38,577 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:06:38,639 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/1440.seqid, newMaxSeqId=1440, maxSeqId=864 2018-05-02 06:06:38,650 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:06:38,652 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,652 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:06:38,652 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,652 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,652 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 06:06:38,652 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 06:06:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,655 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:06:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:06:38,655 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 6e9424b67ac115dc3547de9b3eb4c5ef, disabling compactions & flushes 2018-05-02 06:06:38,656 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:06:38,656 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=580.29 KB memstore heap size=1.19 MB 2018-05-02 06:06:38,793 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=4.57 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/.tmp/f1/60b42671ed6b409aaa6359fb0d738bd1 2018-05-02 06:06:38,817 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=580.29 KB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/.tmp/f1/75a153d8f4a240b1ac387295522fdac6 2018-05-02 06:06:38,835 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/.tmp/f1/60b42671ed6b409aaa6359fb0d738bd1 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/60b42671ed6b409aaa6359fb0d738bd1 2018-05-02 06:06:38,862 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/.tmp/f1/75a153d8f4a240b1ac387295522fdac6 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/75a153d8f4a240b1ac387295522fdac6 2018-05-02 06:06:38,903 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/75a153d8f4a240b1ac387295522fdac6, entries=9180, sequenceid=407, filesize=585.3 K 2018-05-02 06:06:38,907 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/60b42671ed6b409aaa6359fb0d738bd1, entries=74025, sequenceid=407, filesize=4.6 M 2018-05-02 06:06:38,913 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~580.29 KB/594216, heap size ~1.19 MB/1245672, currentsize=0 B/0 for 6e9424b67ac115dc3547de9b3eb4c5ef in 257ms, sequenceid=407, compaction requested=false 2018-05-02 06:06:38,914 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~4.57 MB/4788312, heap size ~9.58 MB/10043248, currentsize=0 B/0 for 7386aea828f5bbf6f2bb9358162092e6 in 667ms, sequenceid=407, compaction requested=false 2018-05-02 06:06:38,955 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:06:38,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:06:38,968 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:38,968 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:38,968 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:38,968 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:06:38,968 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:06:38,969 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:38,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 681566c13ee68fa7a27c4bd39d5a79e0, disabling compactions & flushes 2018-05-02 06:06:38,969 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Running close preflush of {}681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:06:38,969 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.47 MB memstore heap size=32.46 MB 2018-05-02 06:06:39,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,116 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:06:39,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:06:39,117 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,119 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 26d4b78c3c7d2fdea4d32bb21a3ca5fe, disabling compactions & flushes 2018-05-02 06:06:39,119 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:06:39,143 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 11 regions to close 2018-05-02 06:06:39,181 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12412.seqid, newMaxSeqId=12412, maxSeqId=12410 2018-05-02 06:06:39,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,186 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:06:39,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:06:39,187 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,187 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 06:06:39,187 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:06:39,226 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11467.seqid, newMaxSeqId=11467, maxSeqId=11465 2018-05-02 06:06:39,231 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,231 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,231 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,231 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:06:39,231 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:06:39,231 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,232 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 06:06:39,232 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:06:39,265 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12427.seqid, newMaxSeqId=12427, maxSeqId=12425 2018-05-02 06:06:39,270 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,270 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,270 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,270 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:06:39,270 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:06:39,271 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,271 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 06:06:39,271 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:06:39,298 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13469.seqid, newMaxSeqId=13469, maxSeqId=13467 2018-05-02 06:06:39,302 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,302 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,302 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,302 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:06:39,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:06:39,303 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 06:06:39,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:06:39,332 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13222.seqid, newMaxSeqId=13222, maxSeqId=13220 2018-05-02 06:06:39,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,339 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:06:39,341 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:06:39,341 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,344 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 735c68afadbe039ceafe7e37c71a82b8, disabling compactions & flushes 2018-05-02 06:06:39,344 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:06:39,393 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:06:39,399 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,399 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,399 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,400 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:06:39,400 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:06:39,400 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing cb06832d0afac8a9bdbe1f92ad565ab6, disabling compactions & flushes 2018-05-02 06:06:39,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:06:39,439 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12884.seqid, newMaxSeqId=12884, maxSeqId=12882 2018-05-02 06:06:39,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,445 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:06:39,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:06:39,445 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,446 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b7a376d86459306e108ed5a76373661f, disabling compactions & flushes 2018-05-02 06:06:39,446 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Running close preflush of {}b7a376d86459306e108ed5a76373661f 2018-05-02 06:06:39,446 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.39 MB memstore heap size=32.31 MB 2018-05-02 06:06:39,480 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.39 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/.tmp/f1/1aee01e3c8c44a4b8875ca610e35934d 2018-05-02 06:06:39,528 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/.tmp/f1/1aee01e3c8c44a4b8875ca610e35934d as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1/1aee01e3c8c44a4b8875ca610e35934d 2018-05-02 06:06:39,572 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1/1aee01e3c8c44a4b8875ca610e35934d, entries=249657, sequenceid=404, filesize=15.2 M 2018-05-02 06:06:39,579 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~15.39 MB/16137472, heap size ~32.30 MB/33870560, currentsize=0 B/0 for b03e6835fbab67365568f0d2520e68de in 1482ms, sequenceid=404, compaction requested=false 2018-05-02 06:06:39,579 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:06:39,621 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:06:39,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,629 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:06:39,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:06:39,630 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:39,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 06:06:39,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:06:39,706 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12794.seqid, newMaxSeqId=12794, maxSeqId=12792 2018-05-02 06:06:39,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:39,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:39,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:39,711 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:06:39,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:06:40,156 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 2 regions to close 2018-05-02 06:06:40,156 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Online Regions={681566c13ee68fa7a27c4bd39d5a79e0=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0., b7a376d86459306e108ed5a76373661f=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f.} 2018-05-02 06:06:40,418 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.47 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/.tmp/f1/3717a65158e54236b948e9f7a20e1344 2018-05-02 06:06:40,443 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/.tmp/f1/3717a65158e54236b948e9f7a20e1344 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1/3717a65158e54236b948e9f7a20e1344 2018-05-02 06:06:40,472 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1/3717a65158e54236b948e9f7a20e1344, entries=250856, sequenceid=404, filesize=15.3 M 2018-05-02 06:06:40,481 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~15.47 MB/16224448, heap size ~32.46 MB/34033560, currentsize=0 B/0 for 681566c13ee68fa7a27c4bd39d5a79e0 in 1512ms, sequenceid=404, compaction requested=false 2018-05-02 06:06:40,481 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:06:40,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:06:40,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:40,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:40,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:40,525 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:06:40,525 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:06:40,726 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.39 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/.tmp/f1/bae67c56562a4bec8f7072dec02c91fa 2018-05-02 06:06:40,752 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/.tmp/f1/bae67c56562a4bec8f7072dec02c91fa as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1/bae67c56562a4bec8f7072dec02c91fa 2018-05-02 06:06:40,782 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1/bae67c56562a4bec8f7072dec02c91fa, entries=249705, sequenceid=404, filesize=15.2 M 2018-05-02 06:06:40,784 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~15.39 MB/16137472, heap size ~32.31 MB/33877088, currentsize=0 B/0 for b7a376d86459306e108ed5a76373661f in 1338ms, sequenceid=404, compaction requested=false 2018-05-02 06:06:40,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:06:40,811 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:06:40,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:40,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:40,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:40,821 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:06:40,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:06:40,959 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656; all regions closed. 2018-05-02 06:06:40,959 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:06:41,013 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Moved 2 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:06:41,014 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656.meta:.meta(num 1525240035001) 2018-05-02 06:06:41,014 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:06:41,056 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Moved 2 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:06:41,056 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525239699656:(num 1525240034554) 2018-05-02 06:06:41,056 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:06:41,057 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 06:06:41,058 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:06:41,059 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:06:41,066 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 06:06:41,067 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZKLeaderManager: Stepping down as leader 2018-05-02 06:06:41,072 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:06:41,072 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:06:41,072 DEBUG [ZKSecretWatcher-leaderElector] token.AuthenticationTokenSecretManager: Interrupted waiting for next update java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:351) 2018-05-02 06:06:41,079 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:06:41,083 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:06:41,083 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:06:41,083 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:06:41,083 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:06:41,083 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:06:41,083 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:06:41,083 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:06:41,083 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/6 2018-05-02 06:06:41,084 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:06:41,107 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:06:41,107 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b2790082, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:06:41,218 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:06:41,218 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x3631f08b2790082 closed 2018-05-02 06:06:41,219 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656; zookeeper connection closed. 2018-05-02 06:06:41,219 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:06:41,220 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:07:03 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:07:06,824 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:07:06,827 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:07:06,827 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:07:06,827 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:07:06,827 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:07:07,341 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:07:07,342 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:07:07,342 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:07:07,342 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:07:07,343 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:07:07,343 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:07:07,343 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:07:07,344 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:07:07,345 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020607 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:07:07,346 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:07:07,347 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:07:07,347 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:07:07,347 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:07:07,347 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:07:07,348 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:07:07,349 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020607 2018-05-02 06:07:07,349 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:07:07,349 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:07:07,349 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:07:07,349 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:07:07,349 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:07:07,349 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:07:07,350 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:07:07,350 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:07:07,350 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:07:07,352 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:07:07,353 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020607, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:07:07,561 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:07:08,411 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:07:08,627 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:07:09,965 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:07:09,973 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:07:10,616 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:07:10,616 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:07:10,616 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:07:10,779 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:07:11,025 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:07:11,025 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:07:11,071 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:07:11,898 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 06:07:11,925 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:07:11,929 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:07:11,929 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:07:11,930 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:07:11,930 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:07:11,930 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:07:12,219 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:07:12,534 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:07:12,555 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:07:12,773 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 06:07:13,194 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:07:13,198 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:07:13,200 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:07:13,215 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:07:13,217 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:07:13,223 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:07:15,163 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:07:15,182 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:07:15,315 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:07:15,330 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:07:15,330 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:07:15,330 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:07:15,330 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:07:15,330 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:07:15,331 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:07:15,332 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:07:15,332 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:07:15,332 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:07:15,332 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:07:15,332 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:07:15,332 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:07:15,332 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:07:15,333 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:07:15,333 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:07:15,334 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:07:15,389 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:07:15,395 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:07:15,431 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:07:15,443 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:07:15 UTC 2018 2018-05-02 06:07:15,443 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:07:15 UTC 2018 2018-05-02 06:07:15,443 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:07:15,443 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:23:49 UTC 2018 2018-05-02 06:07:15,455 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:07:15,464 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d939009f, negotiated timeout = 90000 2018-05-02 06:07:15,467 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:07:15,468 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f connected 2018-05-02 06:07:15,505 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:07:15,698 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:07:15,698 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:07:15,698 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:07:15,699 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:07:15,699 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:07:15,699 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:07:15,699 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:07:15,707 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:07:15,811 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:07:15,823 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:07:15,824 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:07:15,831 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:07:15,853 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:07:16,327 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:07:16,328 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:07:16,328 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:07:16,394 INFO [main] util.log: Logging initialized @11241ms 2018-05-02 06:07:16,570 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:07:16,598 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:07:16,599 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:07:16,604 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:07:16,604 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:07:16,605 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:07:16,668 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:07:16,671 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:07:16,855 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:07:16,858 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:07:17,329 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:07:17,340 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:07:17,372 INFO [main] server.AbstractConnector: Started ServerConnector@7bec2de8{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:07:17,372 INFO [main] server.Server: Started @12219ms 2018-05-02 06:07:17,454 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:07:17,464 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:07:17,500 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:07:17,501 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:07:17,507 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:07:17,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x7a0d321b to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:07:17,611 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$39/974475919@7f17cba9 2018-05-02 06:07:17,615 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:07:17,616 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:07:17,617 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:07:17,620 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b279009e, negotiated timeout = 90000 2018-05-02 06:07:17,713 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7698b692, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:07:17,716 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24857ba4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:0 2018-05-02 06:07:17,725 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000008:16020 2018-05-02 06:07:17,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:07:17,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:07:17,781 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:07:17,781 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:07:17,781 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:07:17,781 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:07:17,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:07:17,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:07:17,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:07:17,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:07:17,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:07:17,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:07:17,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:07:17,785 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:07:18,067 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:07:18,075 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:07:18,082 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:07:18,082 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:07:18,087 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:07:18,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:07:18,152 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:07:18,152 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:07:18,152 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:07:18,152 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:07:18,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:07:18,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:07:18,170 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:07:18,171 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:07:18,172 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:07:18,172 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:07:18,172 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:07:18,172 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:07:18,173 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:07:18,173 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:07:18,173 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:07:18,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:07:18,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:07:18,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:07:18,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:07:18,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:07:18,298 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:07:18,298 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:07:18,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:07:18,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:07:18,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:07:18,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:07:18,303 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:07:18,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:07:18,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:07:18,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:07:18,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:07:18,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:07:18,313 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:07:18,313 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:07:18,313 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:07:18,313 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:07:18,314 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:07:18,314 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:07:18,314 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:07:18,314 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:07:18,316 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:07:18,316 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:07:18,316 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:07:18,316 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:07:18,317 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:07:18,317 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:07:18,319 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:07:18,319 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:07:18,319 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:07:18,319 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:07:18,320 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:07:18,320 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:07:18,320 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:07:18,324 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:07:18,334 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:07:18,335 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:07:18,702 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:07:19,268 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:07:21,076 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:07:21,077 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:07:26,751 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:07:27,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:07:27,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:07:27,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:07:27,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:07:27,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:07:27,323 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525239798055 with port=16020, startcode=1525241227391 2018-05-02 06:07:27,430 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:07:27,430 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:07:27,432 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:07:27,566 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:07:27,605 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:07:27,722 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:07:27,740 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:07:27,744 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:07:27,751 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:07:27,789 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:07:28,126 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:07:28,127 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:07:28,127 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:07:28,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:07:28,230 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:07:28,638 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:07:28,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:07:28,894 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:07:29,011 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:07:29,026 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:07:29,120 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:07:29,198 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:07:29,198 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:07:29,198 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:07:29,198 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:07:29,198 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:07:29,199 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:07:29,199 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:07:29,203 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:07:29,320 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:07:29,320 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 starting 2018-05-02 06:07:29,326 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:07:29,338 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:07:29,355 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:07:29,361 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:07:29,386 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855] 2018-05-02 06:07:29,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x2631f08d939009f 2018-05-02 06:07:29,563 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:07:29,563 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:07:29,563 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391' 2018-05-02 06:07:29,564 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:07:29,567 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:07:29,568 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:07:29,568 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:07:29,568 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:07:29,568 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391' 2018-05-02 06:07:29,568 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:07:29,569 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:07:29,569 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:07:29,569 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:07:29,569 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:07:32,682 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525241227391, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:07:33,315 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 484 ms, current pipeline: [] 2018-05-02 06:07:33,317 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525241227391.1525241252682 2018-05-02 06:07:33,318 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:08:15,557 DEBUG [RS-EventLoopGroup-1-3] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:08:17,682 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b] zookeeper.ZooKeeper: Session: 0x3631f08b279009e closed 2018-05-02 06:08:17,682 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x7a0d321b-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:08:17,941 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:17,943 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:18,562 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:08:21,566 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:08:21,566 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:08:21,566 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:08:21,753 DEBUG [RS-EventLoopGroup-1-5] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:08:21,760 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:08:21,768 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:08:21,769 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:08:21,770 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:08:21,771 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:08:21,771 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:08:51,916 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:08:53,028 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:53,035 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:54,920 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:08:57,924 DEBUG [RS-EventLoopGroup-1-8] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:08:57,932 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:08:57,949 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:08:57,950 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:08:57,958 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:08:57,959 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:08:57,959 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:09:40,506 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,511 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:09:40,511 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,512 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,514 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:09:40,515 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:09:40,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:09:40,522 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/7 2018-05-02 06:09:40,523 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:10:10,626 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:10:10,635 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:10:10,636 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:10,652 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:10:10,668 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:10,669 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:10:10,672 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:10,673 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:10:10,674 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:10:10,992 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:10:10,992 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:10:11,170 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:10:11,170 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:10:11,180 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:10:11,182 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:10:11,183 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:10:11,190 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:10:11,445 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => bb19a5bd59b1b3dff86020949234aaf5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:10:11,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 83a4166017315b69b94bd868d994447b, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 06:10:11,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 98abf1ead3bf61c95cc4ffe5e6e5fe96, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:10:11,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 3f187e06c01ee258024c3bcea437345b, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:10:11,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => bc0d9cf47453518915ae21d2cf637c18, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:10:11,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => b8144dc37f351e256653e1454207538f, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:10:11,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 41c625158570994727f1c92a8606ca6c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:10:11,448 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 960276b77c021b3663429298ac0cccd7, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7.', STARTKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF', ENDKEY => ''} 2018-05-02 06:10:11,531 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AuthenticationService 2018-05-02 06:10:11,531 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AuthenticationService 2018-05-02 06:10:11,531 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=AuthenticationService 2018-05-02 06:10:11,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=AuthenticationService 2018-05-02 06:10:11,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AuthenticationService 2018-05-02 06:10:11,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AuthenticationService 2018-05-02 06:10:11,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AuthenticationService 2018-05-02 06:10:11,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AuthenticationService 2018-05-02 06:10:11,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,538 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,538 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,539 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,539 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:11,556 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=SecureBulkLoadService 2018-05-02 06:10:11,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,557 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AccessControlService 2018-05-02 06:10:11,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=SecureBulkLoadService 2018-05-02 06:10:11,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=SecureBulkLoadService 2018-05-02 06:10:11,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=SecureBulkLoadService 2018-05-02 06:10:11,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,559 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AccessControlService 2018-05-02 06:10:11,559 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,559 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=SecureBulkLoadService 2018-05-02 06:10:11,567 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,567 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,567 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AccessControlService 2018-05-02 06:10:11,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=SecureBulkLoadService 2018-05-02 06:10:11,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=SecureBulkLoadService 2018-05-02 06:10:11,568 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,568 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,568 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,568 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AccessControlService 2018-05-02 06:10:11,568 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,568 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,568 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,568 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=SecureBulkLoadService 2018-05-02 06:10:11,569 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,569 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,569 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,569 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AccessControlService 2018-05-02 06:10:11,569 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,569 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,570 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,570 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,570 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,570 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AccessControlService 2018-05-02 06:10:11,570 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,570 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:11,571 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:11,571 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,571 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=AccessControlService 2018-05-02 06:10:11,567 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,571 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,571 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,571 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,567 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:11,572 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=AccessControlService 2018-05-02 06:10:11,572 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:11,572 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b8144dc37f351e256653e1454207538f 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 960276b77c021b3663429298ac0cccd7 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 83a4166017315b69b94bd868d994447b 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 41c625158570994727f1c92a8606ca6c 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:10:11,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3f187e06c01ee258024c3bcea437345b 2018-05-02 06:10:11,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:10:11,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:11,814 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:10:11,814 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:10:11,834 DEBUG [StoreOpener-960276b77c021b3663429298ac0cccd7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/f1 2018-05-02 06:10:11,834 DEBUG [StoreOpener-960276b77c021b3663429298ac0cccd7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1 2018-05-02 06:10:11,835 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1 2018-05-02 06:10:11,836 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:10:11,836 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:10:11,836 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:10:11,836 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:10:11,884 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,884 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,884 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,885 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,885 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,887 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,890 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,891 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:11,916 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,916 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,917 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,918 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,918 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,920 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,928 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,929 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:11,973 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,973 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,974 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,973 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,974 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,974 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,974 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,974 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:11,999 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:10:12,002 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:10:12,003 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b 2018-05-02 06:10:12,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b 2018-05-02 06:10:12,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7 2018-05-02 06:10:12,011 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c 2018-05-02 06:10:12,013 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f 2018-05-02 06:10:12,015 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:10:12,183 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,183 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened bb19a5bd59b1b3dff86020949234aaf5; next sequenceid=2 2018-05-02 06:10:12,215 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,216 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened bc0d9cf47453518915ae21d2cf637c18; next sequenceid=2 2018-05-02 06:10:12,218 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,218 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 41c625158570994727f1c92a8606ca6c; next sequenceid=2 2018-05-02 06:10:12,227 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,227 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 3f187e06c01ee258024c3bcea437345b; next sequenceid=2 2018-05-02 06:10:12,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 960276b77c021b3663429298ac0cccd7; next sequenceid=2 2018-05-02 06:10:12,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,294 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 98abf1ead3bf61c95cc4ffe5e6e5fe96; next sequenceid=2 2018-05-02 06:10:12,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,298 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened b8144dc37f351e256653e1454207538f; next sequenceid=2 2018-05-02 06:10:12,298 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:12,298 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 83a4166017315b69b94bd868d994447b; next sequenceid=2 2018-05-02 06:10:12,336 INFO [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:10:12,339 INFO [PostOpenDeployTasks:960276b77c021b3663429298ac0cccd7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:10:12,340 INFO [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:10:12,340 INFO [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:10:12,344 INFO [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:10:12,345 INFO [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:10:12,348 INFO [PostOpenDeployTasks:83a4166017315b69b94bd868d994447b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:10:12,351 INFO [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:10:12,415 DEBUG [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:10:12,417 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:12,423 DEBUG [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:10:12,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:12,424 DEBUG [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:10:12,424 DEBUG [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:10:12,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:12,424 DEBUG [PostOpenDeployTasks:83a4166017315b69b94bd868d994447b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:10:12,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:12,426 DEBUG [PostOpenDeployTasks:960276b77c021b3663429298ac0cccd7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:10:12,426 DEBUG [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:10:12,426 DEBUG [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:10:12,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:12,427 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:12,427 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:12,427 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:10:15,399 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@27d2f847 2018-05-02 06:10:15,403 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:10:15,404 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:10:15,404 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:10:15,408 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900a4, negotiated timeout = 10000 2018-05-02 06:10:15,501 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:10:15,519 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:10:16,595 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:10:16,597 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:10:16,600 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:10:17,106 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:10:17,464 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:10:17,465 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:10:17,668 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:10:17,668 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:10:17,668 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:10:17,691 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:10:17,701 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:10:17,701 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:10:17,785 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:10:18,358 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 06:10:21,055 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:10:21,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:10:21,056 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:10:21,056 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:10:21,057 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:10:21,057 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:10:55,985 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:10:55,985 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:55,985 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:10:55,991 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:56,055 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:10:56,097 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:10:56,771 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:10:56,771 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:56,771 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:10:56,775 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:56,778 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:10:56,785 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:15,419 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:11:15,419 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:15,420 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:11:15,436 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:15,446 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:11:15,472 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:17,144 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:01.787 minutes, events=7354, succcessCount=7354, totalEvents=7354, totalSuccessCount=7354 2018-05-02 06:11:18,662 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 247 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:11:18,936 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.578 minutes, events=10956, succcessCount=8385, totalEvents=10958, totalSuccessCount=8386 2018-05-02 06:11:22,539 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:11:22,539 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:22,539 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:11:22,572 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:22,583 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:11:22,593 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:33,402 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 339 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:11:34,338 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 233 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:11:48,627 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 149 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:11:55,373 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 177 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:11:59,003 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:12:06,606 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 163 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:12:07,740 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 208 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:12:13,212 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 06:12:16,824 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 197 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:12:18,012 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.868 minutes, events=59837, succcessCount=59837, totalEvents=67191, totalSuccessCount=67191 2018-05-02 06:12:19,041 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.106 minutes, events=69459, succcessCount=59866, totalEvents=80417, totalSuccessCount=68252 2018-05-02 06:12:19,297 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 151 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:12:29,361 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=49, reused chunk count=0, reuseRatio=0.00% 2018-05-02 06:12:29,362 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:12:30,700 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 125 ms, current pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 06:12:35,074 DEBUG [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 06:12:35,080 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.9 MTotal Memstore Off-Heap size=0, Region memstore size=30.0 M 2018-05-02 06:12:35,082 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:12:35,084 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.70 MB memstore heap size=29.97 MB 2018-05-02 06:12:37,225 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.70 MB at sequenceid=382 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/.tmp/f1/b9fd06c3a1d143b3955e7818940543a8 2018-05-02 06:12:37,500 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/.tmp/f1/b9fd06c3a1d143b3955e7818940543a8 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/b9fd06c3a1d143b3955e7818940543a8 2018-05-02 06:12:37,547 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/b9fd06c3a1d143b3955e7818940543a8, entries=245836, sequenceid=382, filesize=13.6 M 2018-05-02 06:12:37,572 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~13.70 MB/14363223, heap size ~29.97 MB/31426400, currentsize=174.79 KB/178983 for b8144dc37f351e256653e1454207538f in 2488ms, sequenceid=382, compaction requested=false 2018-05-02 06:12:49,040 DEBUG [RS-EventLoopGroup-1-14] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:12:49,043 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:12:49,043 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,048 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:12:49,051 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,051 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:12:49,053 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,053 DEBUG [RS-EventLoopGroup-1-14] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 06:12:49,053 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:13:20,705 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:01.663 minutes, events=20096, succcessCount=13294, totalEvents=100513, totalSuccessCount=81546 2018-05-02 06:13:32,470 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:32,470 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:32,471 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:32,474 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:32,478 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:32,479 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:33,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454955 bytes) of f1 2018-05-02 06:13:35,134 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:35,134 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:35,142 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:35,150 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:35,152 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:35,153 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:35,708 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:17.696 minutes, events=14355, succcessCount=14355, totalEvents=81546, totalSuccessCount=81546 2018-05-02 06:13:36,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1363785 bytes) of f1 2018-05-02 06:13:37,789 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:37,789 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:37,789 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:37,792 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:37,796 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:37,804 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:38,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454595 bytes) of f1 2018-05-02 06:14:12,032 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:12,032 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:12,033 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:12,035 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:12,038 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:12,039 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:12,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454895 bytes) of f1 2018-05-02 06:14:20,718 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.013 minutes, events=6, succcessCount=3, totalEvents=100519, totalSuccessCount=81549 2018-05-02 06:14:48,276 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:48,276 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:48,277 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:48,279 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:48,281 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:48,283 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:48,466 DEBUG [RS-EventLoopGroup-1-20] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:14:48,468 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:48,468 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:48,475 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:48,477 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:48,477 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:48,478 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:48,478 DEBUG [RS-EventLoopGroup-1-20] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:14:48,483 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:48,486 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:14:48,516 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:14:48,516 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 24479666cac01319b99b1d0e11484b5c, NAME => 'test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 06:14:48,517 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AuthenticationService 2018-05-02 06:14:48,518 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:48,518 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=SecureBulkLoadService 2018-05-02 06:14:48,518 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:48,518 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:48,518 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:48,518 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AccessControlService 2018-05-02 06:14:48,520 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:48,520 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:48,521 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 24479666cac01319b99b1d0e11484b5c 2018-05-02 06:14:48,521 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:14:48,521 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:48,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 5de3546305c82231844eb840c6cfa983, NAME => 'test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:14:48,533 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:14:48,535 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AuthenticationService 2018-05-02 06:14:48,535 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:48,535 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=SecureBulkLoadService 2018-05-02 06:14:48,536 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:48,536 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:48,536 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:48,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AccessControlService 2018-05-02 06:14:48,536 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:48,536 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:48,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5de3546305c82231844eb840c6cfa983 2018-05-02 06:14:48,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:14:48,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:48,578 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 06:14:48,578 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 06:14:48,581 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:14:48,581 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:14:48,583 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:48,584 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:48,586 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:48,587 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:48,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 06:14:48,588 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 06:14:48,588 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:48,588 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 06:14:48,588 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:48,588 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:48,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:48,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 06:14:48,589 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:48,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:48,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 06:14:48,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:14:48,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:48,641 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 06:14:48,641 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 06:14:48,642 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:48,643 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:48,674 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/0acb18db6bda4706bbcda3af69f23a7f 2018-05-02 06:14:48,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454955 bytes) of f1 2018-05-02 06:14:48,701 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1/a22fbfb1317a4c1493bae2cc0fc84cec 2018-05-02 06:14:48,701 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:48,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983 2018-05-02 06:14:48,742 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 06:14:48,742 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:48,753 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 06:14:48,756 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/c96bbf08131a49779b97ac2c5c0843ad 2018-05-02 06:14:48,756 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:48,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c 2018-05-02 06:14:48,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:14:48,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12798.seqid, newMaxSeqId=12798, maxSeqId=12797 2018-05-02 06:14:48,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 5de3546305c82231844eb840c6cfa983; next sequenceid=414 2018-05-02 06:14:48,791 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12798 2018-05-02 06:14:48,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:14:48,795 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:14:48,795 INFO [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:14:48,801 DEBUG [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:14:48,801 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 24479666cac01319b99b1d0e11484b5c; next sequenceid=414 2018-05-02 06:14:48,802 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:14:48,801 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:48,802 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:48,804 INFO [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:14:48,809 DEBUG [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:14:48,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:49,500 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:14:49,511 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => a0792481dc7d859b1b63b04bf9adad81, NAME => 'test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:14:49,511 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AuthenticationService 2018-05-02 06:14:49,511 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:49,511 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=SecureBulkLoadService 2018-05-02 06:14:49,511 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:49,511 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:49,512 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:49,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AccessControlService 2018-05-02 06:14:49,512 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:49,512 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:49,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0792481dc7d859b1b63b04bf9adad81 2018-05-02 06:14:49,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:14:49,513 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:49,526 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 06:14:49,526 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 06:14:49,527 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:49,528 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:49,554 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf/273e08be6b9245749007d7ffc22c666d 2018-05-02 06:14:49,554 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:49,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81 2018-05-02 06:14:49,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11960.seqid, newMaxSeqId=11960, maxSeqId=11959 2018-05-02 06:14:49,625 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened a0792481dc7d859b1b63b04bf9adad81; next sequenceid=11960 2018-05-02 06:14:49,651 INFO [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:14:49,657 DEBUG [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:14:49,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:49,727 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:14:49,748 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 06:14:49,749 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 06:14:49,749 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:49,749 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 06:14:49,749 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:49,749 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:49,750 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:49,750 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 06:14:49,750 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:49,750 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:49,750 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:14:49,750 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:14:49,752 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:49,766 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:14:49,766 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:14:49,767 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:49,772 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:49,839 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 06:14:49,840 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:49,865 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:14:49,919 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12807.seqid, newMaxSeqId=12807, maxSeqId=12806 2018-05-02 06:14:49,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12807 2018-05-02 06:14:49,947 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:14:49,950 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:14:49,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:50,393 DEBUG [RS-EventLoopGroup-1-21] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,394 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:50,394 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,399 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:50,401 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,401 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:50,402 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,402 DEBUG [RS-EventLoopGroup-1-21] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,402 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:50,421 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 8567 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:37756 deadline: 1525241780420, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:50,426 DEBUG [RS-EventLoopGroup-1-22] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,427 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:50,427 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,430 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:50,432 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,432 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:50,433 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,433 DEBUG [RS-EventLoopGroup-1-22] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,433 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:50,437 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=17,queue=1,port=16020] ipc.RpcServer: callId: 1107 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:45538 deadline: 1525241780436, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:50,742 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:15.034 minutes, events=3, succcessCount=3, totalEvents=81549, totalSuccessCount=81549 2018-05-02 06:14:50,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] ipc.RpcServer: callId: 8572 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:37756 deadline: 1525241780806, exception=org.apache.hadoop.hbase.NotServingRegionException: atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:50,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] ipc.RpcServer: callId: 1112 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:45538 deadline: 1525241780806, exception=org.apache.hadoop.hbase.NotServingRegionException: atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. is not online on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:50,911 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:14:50,927 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 5080f353428ccd74e13d5b5493533655, NAME => 'atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:14:50,927 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AuthenticationService 2018-05-02 06:14:50,927 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:50,927 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=SecureBulkLoadService 2018-05-02 06:14:50,928 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:50,928 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:50,928 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:50,928 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AccessControlService 2018-05-02 06:14:50,928 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:50,928 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:50,928 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table atlas_janus 5080f353428ccd74e13d5b5493533655 2018-05-02 06:14:50,928 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:14:50,989 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 06:14:50,992 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:14:50,995 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:51,023 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:14:51,023 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:14:51,024 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for e: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,025 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,074 INFO [StoreFileOpenerThread-e-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 06:14:51,085 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/0a18f12ae332451e8ebd16cff8a678c0 2018-05-02 06:14:51,113 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/2e63be909f0f40689fe9e815839cbb9d 2018-05-02 06:14:51,152 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/42dbd23ebb854897abddb053dc5c571c 2018-05-02 06:14:51,152 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=e, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,161 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:14:51,161 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:14:51,163 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for f: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,163 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,195 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f/44685d33ae944737b0ce1882809b4eb3 2018-05-02 06:14:51,196 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,205 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:14:51,205 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:14:51,207 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for g: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,208 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,239 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/2d33cf99284b43a8bdea139827501c91 2018-05-02 06:14:51,266 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/666308d7d24e43099f67958071f85e72 2018-05-02 06:14:51,291 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/685df9beefd14766b5261170cad893bd 2018-05-02 06:14:51,291 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=g, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,300 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:14:51,300 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:14:51,302 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for h: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,303 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,339 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h/533a2948760c480ba34565e6621f062e 2018-05-02 06:14:51,339 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=h, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,352 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:14:51,352 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:14:51,354 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for i: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,355 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,583 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i/85d84799b3024ff6a31c00aeddf0ee17 2018-05-02 06:14:51,583 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=i, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,592 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:14:51,592 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:14:51,593 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,593 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,596 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,604 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:14:51,604 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:14:51,605 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for m: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,606 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] ipc.RpcServer: callId: 8577 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:37756 deadline: 1525241781629, exception=org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. is opening on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:51,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] ipc.RpcServer: callId: 1117 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:45538 deadline: 1525241781629, exception=org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. is opening on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:51,635 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m/86b207dade28462496c6e41eb3fb7b1f 2018-05-02 06:14:51,636 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,644 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:14:51,644 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:14:51,647 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for s: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,647 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,686 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/ab9566a0b14843359aac2c9357d7f66b 2018-05-02 06:14:51,708 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/e6968dada3bb41138eae59b19cb69762 2018-05-02 06:14:51,708 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=s, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,720 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:14:51,720 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:14:51,721 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for t: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:51,722 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:51,723 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=t, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:51,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655 2018-05-02 06:14:51,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table atlas_janus descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0M)) instead. 2018-05-02 06:14:51,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1615.seqid, newMaxSeqId=1615, maxSeqId=1614 2018-05-02 06:14:51,776 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 5080f353428ccd74e13d5b5493533655; next sequenceid=1615 2018-05-02 06:14:51,784 INFO [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Post open deploy tasks for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:14:51,789 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:51,790 DEBUG [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.CompactSplit: Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:14:51,790 DEBUG [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.CompactSplit: Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2018-05-02 06:14:51,790 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:51,791 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 06:14:51,791 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 06:14:51,794 DEBUG [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Finished post open deploy task for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:14:51,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:51,804 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655.; time since last major compaction 2382852ms 2018-05-02 06:14:51,804 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655.; time since last major compaction 2382631ms 2018-05-02 06:14:51,809 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HStore: 5080f353428ccd74e13d5b5493533655 - e: Initiating major compaction (all files) 2018-05-02 06:14:51,809 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] regionserver.HStore: 5080f353428ccd74e13d5b5493533655 - g: Initiating major compaction (all files) 2018-05-02 06:14:51,812 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] regionserver.HRegion: Starting compaction of g in atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:14:51,812 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HRegion: Starting compaction of e in atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:14:51,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/666308d7d24e43099f67958071f85e72, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/2d33cf99284b43a8bdea139827501c91, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/685df9beefd14766b5261170cad893bd] into tmpdir=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp, totalSize=51.0 K 2018-05-02 06:14:51,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/2e63be909f0f40689fe9e815839cbb9d, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/0a18f12ae332451e8ebd16cff8a678c0, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/42dbd23ebb854897abddb053dc5c571c] into tmpdir=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp, totalSize=89.6 K 2018-05-02 06:14:51,820 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.Compactor: Compacting 2e63be909f0f40689fe9e815839cbb9d, keycount=10383, bloomtype=ROW, size=77.2 K, encoding=FAST_DIFF, seqNum=1589, earliestPutTs=1525237285765001 2018-05-02 06:14:51,820 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compactions.Compactor: Compacting 666308d7d24e43099f67958071f85e72, keycount=2123, bloomtype=ROW, size=39.5 K, encoding=FAST_DIFF, seqNum=1589, earliestPutTs=1525237285765001 2018-05-02 06:14:51,822 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compactions.Compactor: Compacting 2d33cf99284b43a8bdea139827501c91, keycount=41, bloomtype=ROW, size=5.7 K, encoding=FAST_DIFF, seqNum=1601, earliestPutTs=1525239893142001 2018-05-02 06:14:51,823 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.Compactor: Compacting 0a18f12ae332451e8ebd16cff8a678c0, keycount=73, bloomtype=ROW, size=6.2 K, encoding=FAST_DIFF, seqNum=1601, earliestPutTs=1525239893142001 2018-05-02 06:14:51,824 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compactions.Compactor: Compacting 685df9beefd14766b5261170cad893bd, keycount=41, bloomtype=ROW, size=5.8 K, encoding=FAST_DIFF, seqNum=1611, earliestPutTs=1525241410888001 2018-05-02 06:14:51,825 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.Compactor: Compacting 42dbd23ebb854897abddb053dc5c571c, keycount=73, bloomtype=ROW, size=6.2 K, encoding=FAST_DIFF, seqNum=1611, earliestPutTs=1525241410888001 2018-05-02 06:14:51,840 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 06:14:51,934 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:51,938 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:51,963 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:14:51,966 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:14:51,966 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:14:52,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] throttle.PressureAwareThroughputController: 5080f353428ccd74e13d5b5493533655#g#compaction#2 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 10.00 MB/second 2018-05-02 06:14:52,451 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:14:52,454 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp/g/987d25463d724745b9b1288d46bcbfd8 as hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/987d25463d724745b9b1288d46bcbfd8 2018-05-02 06:14:52,467 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 041977f7087dd987f3bc1c3b0d191155, NAME => 'test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:14:52,467 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AuthenticationService 2018-05-02 06:14:52,468 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:52,468 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=SecureBulkLoadService 2018-05-02 06:14:52,468 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:52,468 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:52,468 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:52,470 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AccessControlService 2018-05-02 06:14:52,470 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:52,470 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:52,471 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:14:52,471 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:14:52,471 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:52,488 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:14:52,488 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:14:52,508 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:52,516 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:52,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] regionserver.HStore: Completed major compaction of 3 (all) file(s) in g of 5080f353428ccd74e13d5b5493533655 into 987d25463d724745b9b1288d46bcbfd8(size=41.1 K), total size for store is 41.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 06:14:52,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] regionserver.CompactSplit: Completed compaction region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655., storeName=g, priority=7, startTime=1525241691790; duration=0sec 2018-05-02 06:14:52,564 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-longCompactions-1525241248903] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:14:52,580 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1/f62905fc6764413996ad23803ef34639 2018-05-02 06:14:52,581 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:52,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:14:52,610 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:14:52,616 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 041977f7087dd987f3bc1c3b0d191155; next sequenceid=414 2018-05-02 06:14:52,658 INFO [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:14:52,662 DEBUG [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:14:52,663 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:52,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] throttle.PressureAwareThroughputController: 5080f353428ccd74e13d5b5493533655#e#compaction#1 average throughput is 0.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 06:14:52,995 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp/e/38146263a2ae4ae69e1bcaf0e60354e4 as hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/38146263a2ae4ae69e1bcaf0e60354e4 2018-05-02 06:14:53,053 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HStore: Completed major compaction of 3 (all) file(s) in e of 5080f353428ccd74e13d5b5493533655 into 38146263a2ae4ae69e1bcaf0e60354e4(size=79.7 K), total size for store is 79.7 K. This selection was in queue for 0sec, and took 1sec to execute. 2018-05-02 06:14:53,053 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.CompactSplit: Completed compaction region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655., storeName=e, priority=7, startTime=1525241691788; duration=1sec 2018-05-02 06:14:53,053 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:14:53,482 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:14:53,524 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:14:53,529 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:14:53,533 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:14:53,535 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:14:53,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => bae4cdead31e3a4da5b719f67722e3d8, NAME => 'test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:14:53,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AuthenticationService 2018-05-02 06:14:53,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:53,540 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=SecureBulkLoadService 2018-05-02 06:14:53,540 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:53,540 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:53,540 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:53,540 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AccessControlService 2018-05-02 06:14:53,540 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:53,540 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:53,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 06:14:53,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:14:53,551 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:53,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 3ea52812fafc49b1651e26e1bd43ec97, NAME => 'test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 06:14:53,554 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AuthenticationService 2018-05-02 06:14:53,554 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:53,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=SecureBulkLoadService 2018-05-02 06:14:53,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:53,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:53,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:53,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AccessControlService 2018-05-02 06:14:53,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:53,563 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:53,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 06:14:53,565 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:14:53,566 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:53,576 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 06:14:53,576 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 06:14:53,579 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:53,580 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:53,602 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 06:14:53,602 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 06:14:53,607 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:53,607 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:53,626 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf/bc281d1814c14ba9aae3e3f6022e60f7 2018-05-02 06:14:53,626 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:53,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 06:14:53,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12350.seqid, newMaxSeqId=12350, maxSeqId=12349 2018-05-02 06:14:53,680 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1/2c27a1bafac241928300cca4169c9f94 2018-05-02 06:14:53,680 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:53,681 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened bae4cdead31e3a4da5b719f67722e3d8; next sequenceid=12350 2018-05-02 06:14:53,692 INFO [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:14:53,695 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 06:14:53,699 DEBUG [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:14:53,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:53,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:14:53,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 3ea52812fafc49b1651e26e1bd43ec97; next sequenceid=411 2018-05-02 06:14:53,763 INFO [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:14:53,768 DEBUG [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:14:53,768 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:54,043 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:14:54,527 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:14:54,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:14:54,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 06:14:54,538 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:54,538 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 06:14:54,538 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:54,538 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:54,538 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:54,538 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 06:14:54,538 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:54,538 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:54,538 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:14:54,539 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:14:54,539 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:54,559 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:14:54,559 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:14:54,579 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:54,579 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:54,630 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 06:14:54,630 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:54,653 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:14:54,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11993.seqid, newMaxSeqId=11993, maxSeqId=11992 2018-05-02 06:14:54,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=11993 2018-05-02 06:14:54,747 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:14:54,753 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:14:54,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:54,786 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:14:54,787 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:14:54,902 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:14:54,902 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:14:54,902 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:14:54,907 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:14:54,910 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:14:54,910 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:14:54,950 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:14:54,950 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:14:54,950 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:14:54,950 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:14:55,447 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:14:55,457 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:14:55,458 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:14:55,458 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 06:14:55,458 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:55,458 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 06:14:55,459 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:55,459 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:55,459 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:55,459 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 06:14:55,459 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:55,459 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:55,460 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:14:55,460 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:14:55,460 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:55,468 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:14:55,468 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 06:14:55,468 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:55,468 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 06:14:55,469 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:55,469 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:55,469 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:55,469 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 06:14:55,469 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:55,469 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:55,469 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:14:55,470 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:14:55,470 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:55,478 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:14:55,478 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:14:55,479 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:55,480 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:55,496 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:14:55,496 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:14:55,497 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:55,498 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:55,511 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 06:14:55,511 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:55,518 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:14:55,536 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 06:14:55,536 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:55,543 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:14:55,547 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13226.seqid, newMaxSeqId=13226, maxSeqId=13225 2018-05-02 06:14:55,552 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13226 2018-05-02 06:14:55,556 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:14:55,565 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11530.seqid, newMaxSeqId=11530, maxSeqId=11529 2018-05-02 06:14:55,566 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:14:55,566 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:55,569 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11530 2018-05-02 06:14:55,574 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:14:55,578 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:14:55,578 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:56,264 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:14:56,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:14:56,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 06:14:56,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:56,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 06:14:56,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:56,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:56,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:56,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 06:14:56,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:56,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:56,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:14:56,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:14:56,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:56,294 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:14:56,294 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:14:56,295 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:56,295 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:56,391 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 06:14:56,391 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:56,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:14:56,462 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12431.seqid, newMaxSeqId=12431, maxSeqId=12430 2018-05-02 06:14:56,476 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12431 2018-05-02 06:14:56,486 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:14:56,491 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:14:56,491 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:58,023 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:14:58,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 166b9a4d8133a32343e23907c3228d62, NAME => 'test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:14:58,033 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:14:58,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AuthenticationService 2018-05-02 06:14:58,034 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:58,034 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=SecureBulkLoadService 2018-05-02 06:14:58,034 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:58,034 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:58,034 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:58,034 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AccessControlService 2018-05-02 06:14:58,034 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:58,034 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:58,034 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 166b9a4d8133a32343e23907c3228d62 2018-05-02 06:14:58,035 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:14:58,035 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:58,043 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 411bd5dbc3845cf91c0d9f4649c84b86, NAME => 'test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 06:14:58,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AuthenticationService 2018-05-02 06:14:58,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:58,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=SecureBulkLoadService 2018-05-02 06:14:58,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:58,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:58,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:58,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AccessControlService 2018-05-02 06:14:58,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:58,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:58,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 06:14:58,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:14:58,045 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:14:58,045 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:14:58,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:58,047 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:58,047 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:58,057 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 06:14:58,057 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 06:14:58,058 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:58,059 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:58,083 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1/abd14eb0366d49d6b1f9c4e3beb7ea22 2018-05-02 06:14:58,084 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:58,094 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62 2018-05-02 06:14:58,097 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf/3e55aa0d1ef34928a8504c63d2ce31e2 2018-05-02 06:14:58,097 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:58,103 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 06:14:58,136 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:14:58,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12595.seqid, newMaxSeqId=12595, maxSeqId=12594 2018-05-02 06:14:58,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 166b9a4d8133a32343e23907c3228d62; next sequenceid=414 2018-05-02 06:14:58,145 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 411bd5dbc3845cf91c0d9f4649c84b86; next sequenceid=12595 2018-05-02 06:14:58,148 INFO [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:14:58,152 INFO [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:14:58,156 DEBUG [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:14:58,156 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:58,161 DEBUG [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:14:58,161 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:58,550 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:14:58,551 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:14:58,554 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:14:59,060 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:14:59,631 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:14:59,631 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:14:59,738 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:14:59,738 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:14:59,738 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:14:59,745 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:14:59,750 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:14:59,750 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:14:59,862 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:14:59,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => c078deb2474e9c19b85b5fdb9efaa47d, NAME => 'test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:14:59,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AuthenticationService 2018-05-02 06:14:59,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:59,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=SecureBulkLoadService 2018-05-02 06:14:59,882 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:59,882 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:59,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:59,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AccessControlService 2018-05-02 06:14:59,882 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:59,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:59,883 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:14:59,883 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:14:59,883 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:59,884 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:14:59,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 385c8f00672f754fa0d7448f5ac543fa, NAME => 'test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa.', STARTKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0', ENDKEY => 'r\x86\xBC\xA1\xAF(k\xBA'} 2018-05-02 06:14:59,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AuthenticationService 2018-05-02 06:14:59,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:59,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=SecureBulkLoadService 2018-05-02 06:14:59,892 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:59,893 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:59,893 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:59,893 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AccessControlService 2018-05-02 06:14:59,893 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:59,893 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:59,893 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 385c8f00672f754fa0d7448f5ac543fa 2018-05-02 06:14:59,893 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:14:59,894 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:59,895 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:14:59,895 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:14:59,897 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:59,898 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:59,906 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 06:14:59,906 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 06:14:59,907 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:59,908 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:59,923 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf/0c830418052d48119c37552925d65824 2018-05-02 06:14:59,923 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:59,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:14:59,934 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1/20cc702a3aaf4197b9dd17722b21fc36 2018-05-02 06:14:59,934 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:59,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa 2018-05-02 06:14:59,959 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11359.seqid, newMaxSeqId=11359, maxSeqId=11358 2018-05-02 06:14:59,964 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:14:59,965 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened c078deb2474e9c19b85b5fdb9efaa47d; next sequenceid=11359 2018-05-02 06:14:59,970 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 385c8f00672f754fa0d7448f5ac543fa; next sequenceid=411 2018-05-02 06:14:59,971 INFO [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:14:59,975 DEBUG [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:14:59,975 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:14:59,977 INFO [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:14:59,980 DEBUG [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:14:59,980 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:15:00,081 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:15:00,088 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 681566c13ee68fa7a27c4bd39d5a79e0, NAME => 'test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:15:00,088 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AuthenticationService 2018-05-02 06:15:00,088 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:15:00,088 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=SecureBulkLoadService 2018-05-02 06:15:00,089 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:15:00,089 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:15:00,089 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:15:00,089 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AccessControlService 2018-05-02 06:15:00,089 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:15:00,089 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:15:00,089 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:15:00,089 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:15:00,090 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:00,099 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:15:00,099 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:15:00,100 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:15:00,100 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:15:00,118 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1/3717a65158e54236b948e9f7a20e1344 2018-05-02 06:15:00,118 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:15:00,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:15:00,146 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:15:00,150 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 681566c13ee68fa7a27c4bd39d5a79e0; next sequenceid=411 2018-05-02 06:15:00,152 INFO [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:15:00,156 DEBUG [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:15:00,156 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:15:01,124 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:15:01,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => b52f5cecdefd18652f3e796b8dada29f, NAME => 'test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f.', STARTKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E', ENDKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8'} 2018-05-02 06:15:01,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AuthenticationService 2018-05-02 06:15:01,132 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:15:01,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=SecureBulkLoadService 2018-05-02 06:15:01,133 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:15:01,133 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:15:01,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:15:01,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AccessControlService 2018-05-02 06:15:01,133 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:15:01,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:15:01,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:15:01,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:15:01,134 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:01,147 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:15:01,147 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:15:01,148 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:15:01,148 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:15:01,173 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1/c0a6bd8873ac486db9e40f6c058b5bcd 2018-05-02 06:15:01,173 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:15:01,178 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:15:01,198 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:15:01,202 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened b52f5cecdefd18652f3e796b8dada29f; next sequenceid=411 2018-05-02 06:15:01,205 INFO [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:15:01,207 DEBUG [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:15:01,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:15:04,883 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:15:04,884 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:15:04,890 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:15:05,395 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:15:06,460 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:15:06,460 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:15:06,600 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:15:06,601 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:15:06,601 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:15:06,618 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:15:06,620 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:15:06,620 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:15:16,597 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:15:16,599 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:15:16,603 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:15:17,110 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:15:17,319 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:15:17,319 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:15:17,639 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:15:17,639 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:15:17,639 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:15:17,645 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:15:17,669 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:15:17,669 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:15:18,218 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:18,218 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:18,219 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:18,222 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:18,224 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:18,225 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:18,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454940 bytes) of f1 2018-05-02 06:15:20,761 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.044 minutes, events=55, succcessCount=26, totalEvents=100574, totalSuccessCount=81575 2018-05-02 06:15:29,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/2e63be909f0f40689fe9e815839cbb9d, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/0a18f12ae332451e8ebd16cff8a678c0, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/42dbd23ebb854897abddb053dc5c571c] to archive 2018-05-02 06:15:29,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/666308d7d24e43099f67958071f85e72, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/2d33cf99284b43a8bdea139827501c91, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/685df9beefd14766b5261170cad893bd] to archive 2018-05-02 06:15:29,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archiving compacted files. 2018-05-02 06:15:29,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] backup.HFileArchiver: Archiving compacted files. 2018-05-02 06:15:29,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/666308d7d24e43099f67958071f85e72 to hdfs://mycluster/apps/hbase/data/archive/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/666308d7d24e43099f67958071f85e72 2018-05-02 06:15:29,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/2e63be909f0f40689fe9e815839cbb9d to hdfs://mycluster/apps/hbase/data/archive/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/2e63be909f0f40689fe9e815839cbb9d 2018-05-02 06:15:29,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/2d33cf99284b43a8bdea139827501c91 to hdfs://mycluster/apps/hbase/data/archive/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/2d33cf99284b43a8bdea139827501c91 2018-05-02 06:15:29,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/0a18f12ae332451e8ebd16cff8a678c0 to hdfs://mycluster/apps/hbase/data/archive/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/0a18f12ae332451e8ebd16cff8a678c0 2018-05-02 06:15:29,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/42dbd23ebb854897abddb053dc5c571c to hdfs://mycluster/apps/hbase/data/archive/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/42dbd23ebb854897abddb053dc5c571c 2018-05-02 06:15:29,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/685df9beefd14766b5261170cad893bd to hdfs://mycluster/apps/hbase/data/archive/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/685df9beefd14766b5261170cad893bd 2018-05-02 06:15:37,222 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:37,222 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:37,223 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:37,224 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:37,226 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:37,227 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:37,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454910 bytes) of f1 2018-05-02 06:15:43,510 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:43,511 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:43,511 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:43,513 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:43,516 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:43,516 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:50,755 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.012 minutes, events=38, succcessCount=38, totalEvents=81587, totalSuccessCount=81587 2018-05-02 06:16:20,765 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=52, succcessCount=26, totalEvents=100626, totalSuccessCount=81601 2018-05-02 06:16:50,769 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.014 minutes, events=24, succcessCount=24, totalEvents=81611, totalSuccessCount=81611 2018-05-02 06:17:13,212 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=13.81 MB, freeSize=190.99 MB, max=204.80 MB, blockCount=217, accesses=233, hits=1, hitRatio=0.43%, , cachingAccesses=218, cachingHits=1, cachingHitsRatio=0.46%, evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 06:17:20,795 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.030 minutes, events=48, succcessCount=24, totalEvents=100674, totalSuccessCount=81625 2018-05-02 06:17:29,361 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:17:29,363 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=5, created chunk count=50, reused chunk count=2, reuseRatio=3.85% 2018-05-02 06:17:50,836 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.068 minutes, events=24, succcessCount=24, totalEvents=81635, totalSuccessCount=81635 2018-05-02 06:18:20,849 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.054 minutes, events=48, succcessCount=24, totalEvents=100722, totalSuccessCount=81649 2018-05-02 06:18:50,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.008 minutes, events=24, succcessCount=24, totalEvents=81659, totalSuccessCount=81659 2018-05-02 06:19:20,851 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=48, succcessCount=24, totalEvents=100770, totalSuccessCount=81673 2018-05-02 06:19:35,230 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:19:35,232 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 1179ms. 2018-05-02 06:19:36,413 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 2395ms. 2018-05-02 06:19:38,811 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 2153ms. 2018-05-02 06:19:40,966 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 6588ms. 2018-05-02 06:19:47,557 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 8360ms. 2018-05-02 06:19:50,848 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=24, succcessCount=24, totalEvents=81683, totalSuccessCount=81683 2018-05-02 06:19:55,919 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 13507ms. 2018-05-02 06:20:09,429 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 19454ms. 2018-05-02 06:20:16,597 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:20:16,598 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:20:16,601 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:20:17,109 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:20:17,300 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:20:17,300 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:20:17,464 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:20:17,465 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:20:17,465 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:20:17,482 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:20:17,486 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:20:17,486 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:20:20,855 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=48, succcessCount=24, totalEvents=100818, totalSuccessCount=81697 2018-05-02 06:20:28,885 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Trying to failover after sleeping for 22164ms. 2018-05-02 06:20:50,851 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=24, succcessCount=24, totalEvents=81707, totalSuccessCount=81707 2018-05-02 06:20:51,072 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1007224144_1. Name node is in safe mode. The reported blocks 261 needs additional 223 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1007224144_1. Name node is in safe mode. The reported blocks 261 needs additional 223 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 21318ms. 2018-05-02 06:21:12,395 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1007224144_1. Name node is in safe mode. The reported blocks 388 needs additional 96 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1007224144_1. Name node is in safe mode. The reported blocks 388 needs additional 96 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 10833ms. 2018-05-02 06:21:20,858 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=48, succcessCount=24, totalEvents=100866, totalSuccessCount=81721 2018-05-02 06:21:23,239 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1007224144_1. Name node is in safe mode. The reported blocks 484 has reached the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1007224144_1. Name node is in safe mode. The reported blocks 484 has reached the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 10016ms. 2018-05-02 06:21:50,855 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=24, succcessCount=24, totalEvents=81731, totalSuccessCount=81731 2018-05-02 06:22:13,211 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=13.81 MB, freeSize=190.99 MB, max=204.80 MB, blockCount=217, accesses=233, hits=1, hitRatio=0.43%, , cachingAccesses=218, cachingHits=1, cachingHitsRatio=0.46%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 06:22:20,863 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=48, succcessCount=24, totalEvents=100914, totalSuccessCount=81745 2018-05-02 06:22:29,360 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=5, created chunk count=50, reused chunk count=2, reuseRatio=3.85% 2018-05-02 06:22:29,361 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:22:50,857 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=24, succcessCount=24, totalEvents=81755, totalSuccessCount=81755 2018-05-02 06:23:20,868 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=48, succcessCount=24, totalEvents=100962, totalSuccessCount=81769 2018-05-02 06:23:50,864 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=24, succcessCount=24, totalEvents=81779, totalSuccessCount=81779 2018-05-02 06:23:53,441 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:23:53,442 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:23:53,445 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:23:53,445 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:23:53,446 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:23:53,449 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:23:53,456 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:23:53,457 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/8 2018-05-02 06:23:53,457 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:23:53,482 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:23:53,487 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 znode expired, triggering replicatorRemoved event 2018-05-02 06:23:53,491 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:23:54,034 DEBUG [RS-EventLoopGroup-1-26] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:23:54,036 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:23:54,036 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:54,039 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:23:54,040 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:54,040 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:23:54,041 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:54,041 DEBUG [RS-EventLoopGroup-1-26] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:23:54,041 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:23:54,044 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:23:54,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => b91e4798ff3d5547c13242b7b77e2f63, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:23:54,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=AuthenticationService 2018-05-02 06:23:54,073 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,073 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=SecureBulkLoadService 2018-05-02 06:23:54,073 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,073 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,073 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,073 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=AccessControlService 2018-05-02 06:23:54,073 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,074 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,074 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b91e4798ff3d5547c13242b7b77e2f63 2018-05-02 06:23:54,074 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:23:54,074 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,083 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:23:54,094 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1 2018-05-02 06:23:54,094 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1 2018-05-02 06:23:54,096 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:23:54,096 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:23:54,097 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => f61045f3bb8866c33d9b05635d777d75, NAME => 'test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:23:54,097 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 022c10bc256d7e8dc5d475d7ff8545ea, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:23:54,097 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => e1d84fe7eb9adbf61fec50c75876bce8, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 06:23:54,097 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AuthenticationService 2018-05-02 06:23:54,098 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,098 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=SecureBulkLoadService 2018-05-02 06:23:54,098 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,098 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,098 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,099 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AccessControlService 2018-05-02 06:23:54,097 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AuthenticationService 2018-05-02 06:23:54,099 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,099 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,098 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AuthenticationService 2018-05-02 06:23:54,099 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,099 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=SecureBulkLoadService 2018-05-02 06:23:54,099 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,099 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,099 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,099 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=SecureBulkLoadService 2018-05-02 06:23:54,100 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,100 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,100 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,100 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,100 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AccessControlService 2018-05-02 06:23:54,100 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AccessControlService 2018-05-02 06:23:54,100 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,100 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,100 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,100 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:23:54,100 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,100 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:23:54,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:23:54,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:23:54,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:23:54,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:23:54,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:23:54,102 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,102 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,102 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,111 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,117 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,118 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:23:54,118 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:23:54,119 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,119 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,124 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:23:54,124 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:23:54,126 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,127 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,127 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:23:54,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 084aa7d8a3bd4d7483494d5a2c39d5df, NAME => 'test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:23:54,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AuthenticationService 2018-05-02 06:23:54,128 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=SecureBulkLoadService 2018-05-02 06:23:54,128 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,128 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,129 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AccessControlService 2018-05-02 06:23:54,129 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,129 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:23:54,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:23:54,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,133 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:23:54,133 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:23:54,134 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,135 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,153 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:23:54,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 06:23:54,154 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 06:23:54,154 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,154 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,155 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 06:23:54,155 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,155 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:23:54,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:23:54,156 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,173 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:23:54,173 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:23:54,174 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,175 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,193 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:23:54,194 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:23:54,195 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,195 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,213 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:23:54,214 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 06:23:54,214 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 06:23:54,214 WARN [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #929 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 2018-05-02 06:23:54,214 WARN [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #927 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 2018-05-02 06:23:54,250 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/7f6cc973fc9141ee84218d1cf4abc1f2 2018-05-02 06:23:54,250 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1/f16708f1c3ad4ecc9898112fc1b25f50 2018-05-02 06:23:54,251 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,251 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1/5c55ea585a374e61ae2ef341de1c0c88 2018-05-02 06:23:54,251 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,296 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/58da7717f6144f42a435d0770d1a1079 2018-05-02 06:23:54,299 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63 2018-05-02 06:23:54,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:23:54,324 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf/9f7cb69b6abe4f57bb56248fe3e04156 2018-05-02 06:23:54,324 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,337 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/d5ac413ba8334de5a72f01d06da0f43f 2018-05-02 06:23:54,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:23:54,338 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,348 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/845389644a5e479097fbc8df18727132 2018-05-02 06:23:54,349 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,350 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 06:23:54,350 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,378 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:23:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:23:54,408 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:23:54,412 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:23:54,413 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened e1d84fe7eb9adbf61fec50c75876bce8; next sequenceid=408 2018-05-02 06:23:54,415 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:23:54,418 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened b91e4798ff3d5547c13242b7b77e2f63; next sequenceid=408 2018-05-02 06:23:54,428 INFO [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:23:54,431 DEBUG [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:23:54,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:23:54,441 INFO [PostOpenDeployTasks:b91e4798ff3d5547c13242b7b77e2f63] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:23:54,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12599.seqid, newMaxSeqId=12599, maxSeqId=12598 2018-05-02 06:23:54,447 DEBUG [PostOpenDeployTasks:b91e4798ff3d5547c13242b7b77e2f63] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:23:54,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:23:54,451 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:23:54,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12078.seqid, newMaxSeqId=12078, maxSeqId=12077 2018-05-02 06:23:54,455 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 084aa7d8a3bd4d7483494d5a2c39d5df; next sequenceid=12599 2018-05-02 06:23:54,465 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12078 2018-05-02 06:23:54,467 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened f61045f3bb8866c33d9b05635d777d75; next sequenceid=417 2018-05-02 06:23:54,475 INFO [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:23:54,476 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:23:54,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:23:54,478 DEBUG [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:23:54,478 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:23:54,479 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:23:54,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:23:54,483 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 022c10bc256d7e8dc5d475d7ff8545ea; next sequenceid=411 2018-05-02 06:23:54,487 INFO [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:23:54,493 DEBUG [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:23:54,493 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:23:54,496 INFO [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:23:54,504 DEBUG [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:23:54,506 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:23:59,074 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:23:59,075 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:23:59,079 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:23:59,599 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:24:00,039 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:24:00,039 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:24:00,102 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:24:00,102 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:24:00,102 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:24:00,107 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:24:00,109 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:24:00,109 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:24:20,896 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.028 minutes, events=56, succcessCount=28, totalEvents=101018, totalSuccessCount=81797 2018-05-02 06:24:30,460 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:24:45,727 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:24:45,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 963add1708f89627737d4d216f3449df, NAME => 'test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 06:24:45,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AuthenticationService 2018-05-02 06:24:45,743 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:45,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=SecureBulkLoadService 2018-05-02 06:24:45,744 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:45,744 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:45,744 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:45,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AccessControlService 2018-05-02 06:24:45,744 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:45,744 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:45,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 963add1708f89627737d4d216f3449df 2018-05-02 06:24:45,745 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:24:45,745 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:45,756 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 06:24:45,756 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 06:24:45,757 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:45,757 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:45,780 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf/54a9c57c931f4c86bdd73ac84c990e67 2018-05-02 06:24:45,780 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:45,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df 2018-05-02 06:24:45,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/12532.seqid, newMaxSeqId=12532, maxSeqId=12531 2018-05-02 06:24:45,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 963add1708f89627737d4d216f3449df; next sequenceid=12532 2018-05-02 06:24:45,811 INFO [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:24:45,814 DEBUG [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:24:45,814 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:24:48,224 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\215yC^P\327\224\",1525241408832.83a4166017315b69b94bd868d994447b." 2018-05-02 06:24:48,224 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 83a4166017315b69b94bd868d994447b, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:48,226 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:48,226 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 83a4166017315b69b94bd868d994447b, disabling compactions & flushes 2018-05-02 06:24:48,226 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Running close preflush of {}83a4166017315b69b94bd868d994447b 2018-05-02 06:24:48,226 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.91 MB memstore heap size=30.43 MB 2018-05-02 06:24:48,228 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237." 2018-05-02 06:24:48,228 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close f3db9f9879ed03f488dcb89bea834237, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:48,228 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:48,229 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 06:24:48,229 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:24:48,256 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12080.seqid, newMaxSeqId=12080, maxSeqId=12078 2018-05-02 06:24:48,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:48,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:48,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:48,263 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:24:48,263 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding f3db9f9879ed03f488dcb89bea834237 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=12078 2018-05-02 06:24:48,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:24:48,625 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.91 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/.tmp/f1/feeed6316aa4472a883749a8aeb53dd3 2018-05-02 06:24:48,642 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/.tmp/f1/feeed6316aa4472a883749a8aeb53dd3 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1/feeed6316aa4472a883749a8aeb53dd3 2018-05-02 06:24:48,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1/feeed6316aa4472a883749a8aeb53dd3, entries=249636, sequenceid=404, filesize=13.8 M 2018-05-02 06:24:48,670 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~13.91 MB/14582308, heap size ~30.43 MB/31912120, currentsize=0 B/0 for 83a4166017315b69b94bd868d994447b in 444ms, sequenceid=404, compaction requested=false 2018-05-02 06:24:48,670 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:24:48,690 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:24:48,695 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:48,695 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:48,695 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:48,695 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:24:48,696 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 83a4166017315b69b94bd868d994447b move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=404 2018-05-02 06:24:48,698 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:24:49,333 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3." 2018-05-02 06:24:49,334 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close ce3059196e012fe2ffadcb5d2b348ce3, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:49,334 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\345\ryC^P\327t,1525241408832.b8144dc37f351e256653e1454207538f." 2018-05-02 06:24:49,334 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b8144dc37f351e256653e1454207538f, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:49,335 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:49,335 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:49,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 06:24:49,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b8144dc37f351e256653e1454207538f, disabling compactions & flushes 2018-05-02 06:24:49,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:24:49,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:24:49,335 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=835.10 KB memstore heap size=1.79 MB 2018-05-02 06:24:49,360 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12809.seqid, newMaxSeqId=12809, maxSeqId=12807 2018-05-02 06:24:49,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:49,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:49,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:49,366 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:24:49,366 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding ce3059196e012fe2ffadcb5d2b348ce3 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=12807 2018-05-02 06:24:49,377 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:24:49,416 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=835.10 KB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/.tmp/f1/2634850b34ea44e88f4b0d654c593d82 2018-05-02 06:24:49,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/.tmp/f1/2634850b34ea44e88f4b0d654c593d82 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/2634850b34ea44e88f4b0d654c593d82 2018-05-02 06:24:49,480 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/2634850b34ea44e88f4b0d654c593d82, entries=14659, sequenceid=407, filesize=846.7 K 2018-05-02 06:24:49,485 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~835.10 KB/855141, heap size ~1.79 MB/1874160, currentsize=0 B/0 for b8144dc37f351e256653e1454207538f in 149ms, sequenceid=407, compaction requested=false 2018-05-02 06:24:49,509 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:24:49,514 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:49,514 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:49,514 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:49,514 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:24:49,514 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding b8144dc37f351e256653e1454207538f move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=407 2018-05-02 06:24:49,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:24:50,350 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\177\377\377\377\377\377\377\356,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea." 2018-05-02 06:24:50,351 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 022c10bc256d7e8dc5d475d7ff8545ea, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:50,351 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\353\312\032\362\206\274\241\216,1525239890069.b52f5cecdefd18652f3e796b8dada29f." 2018-05-02 06:24:50,351 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b52f5cecdefd18652f3e796b8dada29f, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:50,351 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:50,351 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:50,351 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 022c10bc256d7e8dc5d475d7ff8545ea, disabling compactions & flushes 2018-05-02 06:24:50,351 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:24:50,351 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing b52f5cecdefd18652f3e796b8dada29f, disabling compactions & flushes 2018-05-02 06:24:50,351 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:24:50,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:24:50,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:24:50,385 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:50,385 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:50,385 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:50,385 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:24:50,386 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionServer: Adding b52f5cecdefd18652f3e796b8dada29f move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=411 2018-05-02 06:24:50,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:50,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:50,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:50,388 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:24:50,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:24:50,388 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Adding 022c10bc256d7e8dc5d475d7ff8545ea move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=411 2018-05-02 06:24:50,390 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:24:50,567 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df." 2018-05-02 06:24:50,567 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 084aa7d8a3bd4d7483494d5a2c39d5df, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:50,568 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:50,568 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 084aa7d8a3bd4d7483494d5a2c39d5df, disabling compactions & flushes 2018-05-02 06:24:50,568 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:24:50,586 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12601.seqid, newMaxSeqId=12601, maxSeqId=12599 2018-05-02 06:24:50,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:50,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:50,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:50,590 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:24:50,590 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionServer: Adding 084aa7d8a3bd4d7483494d5a2c39d5df move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=12599 2018-05-02 06:24:50,593 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:24:50,745 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:24:50,745 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:24:50,747 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:24:50,907 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.043 minutes, events=28, succcessCount=28, totalEvents=81807, totalSuccessCount=81807 2018-05-02 06:24:51,253 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:24:51,456 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:24:51,457 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:24:51,558 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:24:51,558 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:24:51,558 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:24:51,562 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:24:51,564 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:24:51,564 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:25:16,597 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:25:16,598 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:25:16,600 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:25:17,103 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:25:17,456 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:25:17,456 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:25:17,649 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:25:17,649 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:25:17,649 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:25:17,667 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:25:17,678 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:25:17,678 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:25:20,912 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.016 minutes, events=74, succcessCount=35, totalEvents=101092, totalSuccessCount=81832 2018-05-02 06:25:29,439 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:25:29,441 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:25:29,445 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:25:29,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:25:29,453 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/9 2018-05-02 06:25:29,454 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:25:29,458 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 2018-05-02 06:25:29,465 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 znode expired, triggering replicatorRemoved event 2018-05-02 06:25:29,465 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:25:29,942 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:25:29,960 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:25:29,961 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => cdf5d5c10fe0b7d279387a401c3754ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca.', STARTKEY => '\x86\xBC\xA1\xAF(k\xCA\x08', ENDKEY => '\x8DyC^P\xD7\x94"'} 2018-05-02 06:25:29,961 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 93aea36f9251cfe49e28f84a517e3630, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:25:29,961 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AuthenticationService 2018-05-02 06:25:29,961 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=AuthenticationService 2018-05-02 06:25:29,962 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:29,962 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:29,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=SecureBulkLoadService 2018-05-02 06:25:29,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=SecureBulkLoadService 2018-05-02 06:25:29,962 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:29,962 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:29,962 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:29,962 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:29,962 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:29,962 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:29,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AccessControlService 2018-05-02 06:25:29,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=AccessControlService 2018-05-02 06:25:29,963 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:29,963 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:29,963 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:29,963 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:29,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:25:29,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode cdf5d5c10fe0b7d279387a401c3754ca 2018-05-02 06:25:29,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:25:29,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:25:29,964 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:29,964 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:29,964 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:25:29,987 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:25:29,987 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:25:29,989 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:29,989 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 670f6b815d2acac905130e5440d59304, NAME => 'test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 06:25:29,990 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:29,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AuthenticationService 2018-05-02 06:25:29,991 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:29,991 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=SecureBulkLoadService 2018-05-02 06:25:29,991 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:29,991 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:29,991 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:29,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AccessControlService 2018-05-02 06:25:29,992 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:29,992 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:29,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 670f6b815d2acac905130e5440d59304 2018-05-02 06:25:29,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:25:29,993 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:29,993 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1 2018-05-02 06:25:29,993 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1 2018-05-02 06:25:29,995 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:29,995 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:25:29,996 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,014 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:25:30,015 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 06:25:30,015 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,015 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 06:25:30,015 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,015 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,015 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,016 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 06:25:30,016 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,016 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,016 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:25:30,016 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:25:30,017 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,018 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:25:30,018 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 29fe0b7866912efc70bb3f2d7fd83059, NAME => 'test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:25:30,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AuthenticationService 2018-05-02 06:25:30,019 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=SecureBulkLoadService 2018-05-02 06:25:30,019 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,019 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,019 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AccessControlService 2018-05-02 06:25:30,019 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,019 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:25:30,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:25:30,020 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,020 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:25:30,034 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 06:25:30,034 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 06:25:30,036 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,036 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 93f2d602c0a0a654856fb16863c2ff38, NAME => 'test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:25:30,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AuthenticationService 2018-05-02 06:25:30,042 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=SecureBulkLoadService 2018-05-02 06:25:30,042 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,042 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,042 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AccessControlService 2018-05-02 06:25:30,043 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,043 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,043 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:25:30,043 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:25:30,043 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:25:30,043 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:25:30,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 06:25:30,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 06:25:30,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 06:25:30,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 06:25:30,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:25:30,078 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,078 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:25:30,079 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:25:30,080 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,081 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,094 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1/4ad7c958e814455ea328234413e3e47e 2018-05-02 06:25:30,094 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,099 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:25:30,099 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:25:30,100 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/335c9d0ca00f43be9b2be1bdaf09a958 2018-05-02 06:25:30,100 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:25:30,100 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:25:30,100 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,101 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,101 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,102 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca 2018-05-02 06:25:30,134 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:25:30,134 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:25:30,135 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,136 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,167 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf/25e0a99365ef45e2b122cf95cdb0162d 2018-05-02 06:25:30,168 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,171 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/8cbf0c74e0754545a377c74c6bcdb70f 2018-05-02 06:25:30,171 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,188 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf/f5f702b4ca0c43be911590949f4eda41 2018-05-02 06:25:30,188 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,200 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1/da3881a0cb0542f0a0fdfe2ffd2e6aba 2018-05-02 06:25:30,201 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:25:30,223 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:25:30,227 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304 2018-05-02 06:25:30,238 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:25:30,239 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/3297ed693bf547c9a14efacdfd81288d 2018-05-02 06:25:30,250 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 06:25:30,251 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:25:30,264 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened cdf5d5c10fe0b7d279387a401c3754ca; next sequenceid=411 2018-05-02 06:25:30,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 06:25:30,275 INFO [PostOpenDeployTasks:cdf5d5c10fe0b7d279387a401c3754ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:25:30,278 DEBUG [PostOpenDeployTasks:cdf5d5c10fe0b7d279387a401c3754ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:25:30,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:25:30,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12202.seqid, newMaxSeqId=12202, maxSeqId=12201 2018-05-02 06:25:30,285 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/b3695ba3826443ff91ddc686509faa2a 2018-05-02 06:25:30,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:25:30,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 670f6b815d2acac905130e5440d59304; next sequenceid=12202 2018-05-02 06:25:30,299 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 93aea36f9251cfe49e28f84a517e3630; next sequenceid=411 2018-05-02 06:25:30,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:25:30,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12761.seqid, newMaxSeqId=12761, maxSeqId=12760 2018-05-02 06:25:30,302 INFO [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:25:30,304 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 29fe0b7866912efc70bb3f2d7fd83059; next sequenceid=12761 2018-05-02 06:25:30,305 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 93f2d602c0a0a654856fb16863c2ff38; next sequenceid=417 2018-05-02 06:25:30,306 DEBUG [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:25:30,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:25:30,307 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/eaed850681d24ac8926671fb83799c09 2018-05-02 06:25:30,308 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12548.seqid, newMaxSeqId=12548, maxSeqId=12547 2018-05-02 06:25:30,309 INFO [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:25:30,310 INFO [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:25:30,310 INFO [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:25:30,312 DEBUG [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:25:30,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:25:30,312 DEBUG [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:25:30,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:25:30,313 DEBUG [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:25:30,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:25:30,314 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12548 2018-05-02 06:25:30,316 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:25:30,319 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:25:30,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:25:30,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:25:30,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/68.seqid, newMaxSeqId=68, maxSeqId=67 2018-05-02 06:25:30,351 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=68 2018-05-02 06:25:30,356 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:25:30,356 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,356 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 06:25:30,357 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.CompactSplit: Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:25:30,359 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:25:30,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:25:30,361 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.; time since last major compaction 2743470ms 2018-05-02 06:25:30,361 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HStore: 8dc6fd2022c2fdf8c065fbd16cadaaca - dt: Initiating major compaction (all files) 2018-05-02 06:25:30,361 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HRegion: Starting compaction of dt in ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:25:30,361 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/b3695ba3826443ff91ddc686509faa2a, hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/eaed850681d24ac8926671fb83799c09, hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/3297ed693bf547c9a14efacdfd81288d] into tmpdir=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/.tmp, totalSize=22.8 K 2018-05-02 06:25:30,362 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.Compactor: Compacting b3695ba3826443ff91ddc686509faa2a, keycount=168, bloomtype=ROW, size=11.1 K, encoding=FAST_DIFF, seqNum=44, earliestPutTs=1525237327475 2018-05-02 06:25:30,364 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.Compactor: Compacting eaed850681d24ac8926671fb83799c09, keycount=9, bloomtype=ROW, size=5.9 K, encoding=FAST_DIFF, seqNum=53, earliestPutTs=1525239892856 2018-05-02 06:25:30,365 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] compactions.Compactor: Compacting 3297ed693bf547c9a14efacdfd81288d, keycount=9, bloomtype=ROW, size=5.9 K, encoding=FAST_DIFF, seqNum=64, earliestPutTs=1525241410805 2018-05-02 06:25:30,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,488 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] throttle.PressureAwareThroughputController: 8dc6fd2022c2fdf8c065fbd16cadaaca#dt#compaction#5 average throughput is 4.63 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 06:25:30,576 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/.tmp/dt/365f190e72194d82bee2f109d2425208 as hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/365f190e72194d82bee2f109d2425208 2018-05-02 06:25:30,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.HStore: Completed major compaction of 3 (all) file(s) in dt of 8dc6fd2022c2fdf8c065fbd16cadaaca into 365f190e72194d82bee2f109d2425208(size=12.7 K), total size for store is 12.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 06:25:30,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.CompactSplit: Completed compaction region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca., storeName=dt, priority=7, startTime=1525242330356; duration=0sec 2018-05-02 06:25:30,609 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525241691788] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:25:31,014 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:25:34,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:25:34,964 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:25:34,967 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:25:35,472 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:25:36,042 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:25:36,043 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:25:36,155 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:25:36,155 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:25:36,155 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:25:36,165 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:25:36,168 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:25:36,168 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:25:53,907 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:03.000 minutes, events=43, succcessCount=43, totalEvents=81850, totalSuccessCount=81850 2018-05-02 06:26:00,803 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:26:20,917 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=60, succcessCount=30, totalEvents=101152, totalSuccessCount=81862 2018-05-02 06:26:53,912 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=23, succcessCount=23, totalEvents=81873, totalSuccessCount=81873 2018-05-02 06:26:56,688 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 2018-05-02 06:26:56,692 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 znode expired, triggering replicatorRemoved event 2018-05-02 06:26:56,692 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:26:57,040 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:26:57,054 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:26:57,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => b89f4262e34dfdd1fbea3661f9d50263, NAME => 'hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:26:57,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AuthenticationService 2018-05-02 06:26:57,055 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=SecureBulkLoadService 2018-05-02 06:26:57,056 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,056 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AccessControlService 2018-05-02 06:26:57,056 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table acl b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:26:57,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:26:57,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 4c37ee7a4e1210e481debdc2933fc4d2, NAME => 'test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 06:26:57,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AuthenticationService 2018-05-02 06:26:57,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=SecureBulkLoadService 2018-05-02 06:26:57,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AccessControlService 2018-05-02 06:26:57,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 06:26:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:26:57,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,078 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:26:57,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:26:57,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 06:26:57,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 06:26:57,079 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,079 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,080 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 06:26:57,080 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,080 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,080 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:26:57,080 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:26:57,081 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,087 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:26:57,092 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:26:57,092 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:26:57,093 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,093 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,100 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,109 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 06:26:57,109 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 06:26:57,110 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,110 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,120 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:26:57,120 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:26:57,121 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,121 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,123 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:26:57,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 06:26:57,124 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 06:26:57,124 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,124 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,124 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 06:26:57,125 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,125 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,125 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:26:57,125 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:26:57,125 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,126 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:26:57,126 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:26:57,127 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:26:57,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:26:57,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:26:57,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 06:26:57,129 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 06:26:57,129 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,129 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,129 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 06:26:57,130 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,130 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:26:57,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:26:57,130 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 06:26:57,131 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 06:26:57,131 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,131 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,132 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 06:26:57,132 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,132 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:26:57,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:26:57,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,136 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:26:57,160 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => b9be42c9bb7b350e67325f3e6a3a59fb, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:26:57,161 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=AuthenticationService 2018-05-02 06:26:57,161 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,161 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=SecureBulkLoadService 2018-05-02 06:26:57,161 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,161 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,161 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,161 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=AccessControlService 2018-05-02 06:26:57,161 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,161 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,162 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b9be42c9bb7b350e67325f3e6a3a59fb 2018-05-02 06:26:57,162 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:26:57,162 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,168 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf/719182bd2f5b43a9b5002dd5ebd23549 2018-05-02 06:26:57,169 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,181 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 06:26:57,183 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:26:57,183 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:26:57,184 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:26:57,184 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:26:57,185 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,185 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,186 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,186 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:26:57,186 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:26:57,186 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,187 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,188 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,189 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1 2018-05-02 06:26:57,189 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1 2018-05-02 06:26:57,189 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,190 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,209 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 06:26:57,209 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,217 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:26:57,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/26.seqid, newMaxSeqId=26, maxSeqId=25 2018-05-02 06:26:57,259 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 06:26:57,259 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:26:57,263 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened b89f4262e34dfdd1fbea3661f9d50263; next sequenceid=26 2018-05-02 06:26:57,273 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 06:26:57,273 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:26:57,280 INFO [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:26:57,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 93a15c4ca6299bea02a86ac40494d75a, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:26:57,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AuthenticationService 2018-05-02 06:26:57,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=SecureBulkLoadService 2018-05-02 06:26:57,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AccessControlService 2018-05-02 06:26:57,283 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:26:57,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:26:57,285 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:26:57,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12245.seqid, newMaxSeqId=12245, maxSeqId=12244 2018-05-02 06:26:57,285 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:26:57,285 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 9f9b6704233f2d2e06a5634fda7f94ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AuthenticationService 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 1bf9126ca1d7eb9abb934165d5f25857, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:26:57,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=SecureBulkLoadService 2018-05-02 06:26:57,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AuthenticationService 2018-05-02 06:26:57,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=SecureBulkLoadService 2018-05-02 06:26:57,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AccessControlService 2018-05-02 06:26:57,287 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:26:57,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:26:57,287 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,288 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,288 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AccessControlService 2018-05-02 06:26:57,288 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:26:57,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:26:57,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,292 DEBUG [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Finished post open deploy task for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:26:57,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,293 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 06:26:57,293 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:26:57,297 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 4c37ee7a4e1210e481debdc2933fc4d2; next sequenceid=12245 2018-05-02 06:26:57,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:26:57,321 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:26:57,322 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 9c4d77e622ed44a126e39f057f044750, NAME => 'test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750.', STARTKEY => '\xA1\xAF(k\xCA\x1A\xF2p', ENDKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A'} 2018-05-02 06:26:57,322 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => a6d67b9eb3447b55a82b542d202ddd20, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:26:57,322 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AuthenticationService 2018-05-02 06:26:57,322 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=AuthenticationService 2018-05-02 06:26:57,323 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=SecureBulkLoadService 2018-05-02 06:26:57,323 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,323 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,323 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=AccessControlService 2018-05-02 06:26:57,323 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,323 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a6d67b9eb3447b55a82b542d202ddd20 2018-05-02 06:26:57,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:26:57,324 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,322 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,325 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=SecureBulkLoadService 2018-05-02 06:26:57,326 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,326 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,326 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AccessControlService 2018-05-02 06:26:57,326 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,326 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 9c4d77e622ed44a126e39f057f044750 2018-05-02 06:26:57,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:26:57,327 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,328 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:26:57,328 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:26:57,329 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,329 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,329 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1/ec664e55bd53459b869c26a0f2088bcc 2018-05-02 06:26:57,332 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,333 INFO [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:26:57,336 DEBUG [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:26:57,336 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12244.seqid, newMaxSeqId=12244, maxSeqId=12243 2018-05-02 06:26:57,398 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:26:57,398 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:26:57,399 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,410 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13647.seqid, newMaxSeqId=13647, maxSeqId=13646 2018-05-02 06:26:57,411 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,414 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,418 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:26:57,419 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:26:57,420 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,420 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,421 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb 2018-05-02 06:26:57,423 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1 2018-05-02 06:26:57,423 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1 2018-05-02 06:26:57,424 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=12244 2018-05-02 06:26:57,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12459.seqid, newMaxSeqId=12459, maxSeqId=12458 2018-05-02 06:26:57,425 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,426 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,427 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13647 2018-05-02 06:26:57,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:26:57,430 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:26:57,432 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12459 2018-05-02 06:26:57,432 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:26:57,437 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 06:26:57,443 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 06:26:57,441 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:26:57,451 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,455 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,457 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11457.seqid, newMaxSeqId=11457, maxSeqId=11456 2018-05-02 06:26:57,461 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:26:57,461 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,462 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:26:57,462 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,462 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:26:57,463 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,468 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11457 2018-05-02 06:26:57,513 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1/3d0f7026a4ef4c89aa664ab8b925b29f 2018-05-02 06:26:57,515 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:26:57,517 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:26:57,517 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,523 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,529 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1/39f70bcc389446a6a85d27019cee494f 2018-05-02 06:26:57,529 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1/5c806a6a8d2b4ef982bb8ac97a2fe60d 2018-05-02 06:26:57,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:26:57,538 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,538 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,545 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened b9be42c9bb7b350e67325f3e6a3a59fb; next sequenceid=408 2018-05-02 06:26:57,547 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 06:26:57,548 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:26:57,549 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20 2018-05-02 06:26:57,559 INFO [PostOpenDeployTasks:b9be42c9bb7b350e67325f3e6a3a59fb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:26:57,564 DEBUG [PostOpenDeployTasks:b9be42c9bb7b350e67325f3e6a3a59fb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:26:57,564 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:26:57,568 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 93a15c4ca6299bea02a86ac40494d75a; next sequenceid=5 2018-05-02 06:26:57,577 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1/fc387eb319f242cba0384b0a240bb24d 2018-05-02 06:26:57,597 INFO [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:26:57,599 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,602 DEBUG [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:26:57,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:26:57,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:26:57,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750 2018-05-02 06:26:57,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:26:57,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened a6d67b9eb3447b55a82b542d202ddd20; next sequenceid=408 2018-05-02 06:26:57,617 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 9f9b6704233f2d2e06a5634fda7f94ca; next sequenceid=408 2018-05-02 06:26:57,619 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 1bf9126ca1d7eb9abb934165d5f25857; next sequenceid=411 2018-05-02 06:26:57,624 INFO [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:26:57,630 DEBUG [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:26:57,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,636 INFO [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:26:57,636 INFO [PostOpenDeployTasks:a6d67b9eb3447b55a82b542d202ddd20] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:26:57,639 DEBUG [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:26:57,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,641 DEBUG [PostOpenDeployTasks:a6d67b9eb3447b55a82b542d202ddd20] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:26:57,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:26:57,648 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:26:57,652 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 9c4d77e622ed44a126e39f057f044750; next sequenceid=414 2018-05-02 06:26:57,656 INFO [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:26:57,663 DEBUG [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:26:57,663 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:27:01,023 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:27:02,057 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:27:02,059 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:27:02,061 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:27:02,565 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:27:03,029 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:27:03,030 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:27:03,192 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:27:03,192 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:27:03,192 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:27:03,200 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:27:03,209 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:27:03,209 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:27:13,211 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=13.81 MB, freeSize=190.99 MB, max=204.80 MB, blockCount=217, accesses=237, hits=1, hitRatio=0.42%, , cachingAccesses=218, cachingHits=1, cachingHitsRatio=0.46%, evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 06:27:20,921 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=54, succcessCount=27, totalEvents=101206, totalSuccessCount=81889 2018-05-02 06:27:29,360 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=13, created chunk count=50, reused chunk count=2, reuseRatio=3.85% 2018-05-02 06:27:29,361 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:27:30,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/b3695ba3826443ff91ddc686509faa2a, hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/eaed850681d24ac8926671fb83799c09, hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/3297ed693bf547c9a14efacdfd81288d] to archive 2018-05-02 06:27:30,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] backup.HFileArchiver: Archiving compacted files. 2018-05-02 06:27:30,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/b3695ba3826443ff91ddc686509faa2a to hdfs://mycluster/apps/hbase/data/archive/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/b3695ba3826443ff91ddc686509faa2a 2018-05-02 06:27:30,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/eaed850681d24ac8926671fb83799c09 to hdfs://mycluster/apps/hbase/data/archive/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/eaed850681d24ac8926671fb83799c09 2018-05-02 06:27:30,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/3297ed693bf547c9a14efacdfd81288d to hdfs://mycluster/apps/hbase/data/archive/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/3297ed693bf547c9a14efacdfd81288d 2018-05-02 06:27:30,729 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:27:53,920 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=28, succcessCount=28, totalEvents=81901, totalSuccessCount=81901 2018-05-02 06:28:20,928 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=48, succcessCount=24, totalEvents=101254, totalSuccessCount=81913 2018-05-02 06:28:26,165 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:28:26,177 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 znode expired, triggering replicatorRemoved event 2018-05-02 06:28:26,178 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:28:28,680 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:28:28,697 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:28:28,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 3ca34b6bdc72922097d54ce260dbd903, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903.', STARTKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C', ENDKEY => '\xD0\xD7\x945\xE5\x0Dy&'} 2018-05-02 06:28:28,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AuthenticationService 2018-05-02 06:28:28,698 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=SecureBulkLoadService 2018-05-02 06:28:28,698 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,698 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,698 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AccessControlService 2018-05-02 06:28:28,699 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,699 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:28:28,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:28:28,699 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,712 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:28:28,713 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:28:28,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:28:28,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => b32f7e3b20e736fd1681093bef6b435d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:28:28,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 06:28:28,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=AuthenticationService 2018-05-02 06:28:28,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 06:28:28,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=SecureBulkLoadService 2018-05-02 06:28:28,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=AccessControlService 2018-05-02 06:28:28,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b32f7e3b20e736fd1681093bef6b435d 2018-05-02 06:28:28,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:28:28,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 06:28:28,716 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,716 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:28:28,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:28:28,716 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,719 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:28:28,719 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:28:28,720 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,721 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,753 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:28:28,753 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:28:28,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 06:28:28,754 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 06:28:28,754 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,754 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,754 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 06:28:28,754 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,754 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:28:28,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:28:28,755 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,762 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:28:28,762 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:28:28,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => b03e6835fbab67365568f0d2520e68de, NAME => 'test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 06:28:28,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => a3403d29839e289caca7a1e3c5cd71be, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:28:28,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 298977e880ecf479f4c50be95a5e8eb5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:28:28,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AuthenticationService 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AuthenticationService 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=SecureBulkLoadService 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AuthenticationService 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=SecureBulkLoadService 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=SecureBulkLoadService 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AccessControlService 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AccessControlService 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AccessControlService 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,764 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,764 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:28:28,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:28:28,764 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1 2018-05-02 06:28:28,764 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1 2018-05-02 06:28:28,764 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,764 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b03e6835fbab67365568f0d2520e68de 2018-05-02 06:28:28,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:28:28,765 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,765 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,765 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:28:28,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:28:28,765 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,765 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,778 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:28:28,778 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:28:28,779 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,779 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,786 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:28:28,786 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:28:28,787 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,788 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,808 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:28:28,808 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:28:28,809 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,821 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:28:28,836 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:28:28,821 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:28:28,837 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:28:28,826 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,826 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1/7914c5e37a8a4498ac542a00c9e38435 2018-05-02 06:28:28,841 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:28,844 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,844 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=217, currentSize=13.81 MB, freeSize=190.99 MB, maxSize=204.80 MB, heapSize=13.81 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,845 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,846 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,874 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/60b614564dba4b2ebef91378bb1169f6 2018-05-02 06:28:28,875 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:28:28,934 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 06:28:28,934 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:28,937 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 06:28:28,937 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:28,958 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:28:28,961 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1/1aee01e3c8c44a4b8875ca610e35934d 2018-05-02 06:28:28,961 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:28,961 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/aca5a68c0e414fe7b1239ba0d951dc5f 2018-05-02 06:28:28,962 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:28,963 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1/5dd531f9eb2a49a68712ee9638f0247b 2018-05-02 06:28:28,963 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:28,966 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:28:28,975 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:28:28,987 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de 2018-05-02 06:28:28,987 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d 2018-05-02 06:28:28,990 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 3ca34b6bdc72922097d54ce260dbd903; next sequenceid=411 2018-05-02 06:28:28,997 INFO [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:28:29,004 DEBUG [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:28:29,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:28:29,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:28:29,014 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/1b1b3109d73b4cc99883318973d6daff 2018-05-02 06:28:29,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12720.seqid, newMaxSeqId=12720, maxSeqId=12719 2018-05-02 06:28:29,071 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=12720 2018-05-02 06:28:29,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12783.seqid, newMaxSeqId=12783, maxSeqId=12782 2018-05-02 06:28:29,081 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/e948a42d644f4854aaf007ff04010533 2018-05-02 06:28:29,082 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,083 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:28:29,091 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:28:29,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:28:29,115 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:28:29,115 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12783 2018-05-02 06:28:29,118 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:28:29,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:28:29,122 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:28:29,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:28:29,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened b03e6835fbab67365568f0d2520e68de; next sequenceid=414 2018-05-02 06:28:29,142 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:28:29,145 INFO [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:28:29,148 DEBUG [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:28:29,149 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:28:29,174 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:28:29,195 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened b32f7e3b20e736fd1681093bef6b435d; next sequenceid=411 2018-05-02 06:28:29,205 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 298977e880ecf479f4c50be95a5e8eb5; next sequenceid=411 2018-05-02 06:28:29,244 INFO [PostOpenDeployTasks:b32f7e3b20e736fd1681093bef6b435d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:28:29,246 INFO [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:28:29,248 DEBUG [PostOpenDeployTasks:b32f7e3b20e736fd1681093bef6b435d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:28:29,248 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:28:29,249 DEBUG [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:28:29,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:28:29,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:28:29,294 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened a3403d29839e289caca7a1e3c5cd71be; next sequenceid=417 2018-05-02 06:28:29,301 INFO [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:28:29,304 DEBUG [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:28:29,304 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:28:33,699 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:28:33,700 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:28:33,703 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:28:34,210 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:28:34,572 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:28:34,573 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:28:34,680 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:28:34,681 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:28:34,681 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:28:34,687 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:28:34,689 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:28:34,690 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:28:53,921 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=29, succcessCount=29, totalEvents=81930, totalSuccessCount=81930 2018-05-02 06:28:57,504 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:29:23,745 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:02.816 minutes, events=60, succcessCount=29, totalEvents=101314, totalSuccessCount=81942 Wed May 2 06:29:50 UTC 2018 Terminating regionserver 2018-05-02 06:29:50,581 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:29:50,582 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:29:50,582 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:29:50,582 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:29:50,582 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:29:50,587 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:29:50,587 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:29:50,587 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=56.666 seconds, events=24, succcessCount=24, totalEvents=81954, totalSuccessCount=81954 2018-05-02 06:29:50,587 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:29:50,587 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=26.843 seconds, events=22, succcessCount=12, totalEvents=101336, totalSuccessCount=81954 2018-05-02 06:29:50,587 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:29:50,587 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:29:51,582 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:29:51,582 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:29:51,582 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:29:51,582 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:29:51,583 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1000 milli seconds 2018-05-02 06:29:51,583 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:29:51,583 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:29:51,583 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:29:51,583 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:29:51,583 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:29:51,583 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391' ***** 2018-05-02 06:29:51,583 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:29:51,583 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:29:51,583 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:29:51,583 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:29:51,584 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:29:51,584 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:29:51,584 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,584 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:29:51,584 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:29:51,584 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:29:51,584 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:29:51,584 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:29:51,586 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,586 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:29:51,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:29:51,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:29:51,586 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:29:51,586 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 exiting 2018-05-02 06:29:51,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:29:51,607 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@7bec2de8{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:29:51,607 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:29:51,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:29:51,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:29:51,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:29:51,611 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:29:51,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:29:51,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 041977f7087dd987f3bc1c3b0d191155, disabling compactions & flushes 2018-05-02 06:29:51,612 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b32f7e3b20e736fd1681093bef6b435d, disabling compactions & flushes 2018-05-02 06:29:51,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:29:51,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:29:51,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 5de3546305c82231844eb840c6cfa983, disabling compactions & flushes 2018-05-02 06:29:51,612 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:29:51,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:29:51,613 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,613 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,613 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,613 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,614 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,614 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,614 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,622 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,622 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,622 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,622 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,622 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,624 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,624 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,624 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,624 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,624 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:29:51,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:29:51,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x7a0d321b to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:29:51,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:29:51,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 53 regions to close 2018-05-02 06:29:51,647 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:51,653 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:51,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:51,655 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:29:51,656 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:29:51,656 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 06:29:51,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:29:51,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,657 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:29:51,658 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:29:51,658 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,658 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b03e6835fbab67365568f0d2520e68de, disabling compactions & flushes 2018-05-02 06:29:51,658 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:29:51,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,660 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:29:51,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:29:51,660 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 9c4d77e622ed44a126e39f057f044750, disabling compactions & flushes 2018-05-02 06:29:51,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:29:51,673 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12461.seqid, newMaxSeqId=12461, maxSeqId=12459 2018-05-02 06:29:51,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:51,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:51,677 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,677 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,677 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,677 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:29:51,678 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:29:51,678 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,678 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 166b9a4d8133a32343e23907c3228d62, disabling compactions & flushes 2018-05-02 06:29:51,678 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:29:51,679 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,679 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,679 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,679 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,679 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,679 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,679 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:29:51,679 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:29:51,680 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:29:51,680 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:29:51,680 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,680 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 385c8f00672f754fa0d7448f5ac543fa, disabling compactions & flushes 2018-05-02 06:29:51,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 06:29:51,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:29:51,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:51,695 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:51,708 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12550.seqid, newMaxSeqId=12550, maxSeqId=12548 2018-05-02 06:29:51,708 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:51,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,712 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:29:51,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:29:51,712 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 1182d8ac9fbcff5334cd5fda2cf0c4a0, disabling compactions & flushes 2018-05-02 06:29:51,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,714 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:51,714 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:29:51,714 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,714 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 3f187e06c01ee258024c3bcea437345b, disabling compactions & flushes 2018-05-02 06:29:51,715 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Running close preflush of {}3f187e06c01ee258024c3bcea437345b 2018-05-02 06:29:51,715 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 5080f353428ccd74e13d5b5493533655, disabling compactions & flushes 2018-05-02 06:29:51,715 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:51,715 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=14.29 MB memstore heap size=31.26 MB 2018-05-02 06:29:51,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13649.seqid, newMaxSeqId=13649, maxSeqId=13647 2018-05-02 06:29:51,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1619.seqid, newMaxSeqId=1619, maxSeqId=1615 2018-05-02 06:29:51,731 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,731 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,731 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,731 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:29:51,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:29:51,732 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 3ca34b6bdc72922097d54ce260dbd903, disabling compactions & flushes 2018-05-02 06:29:51,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:29:51,733 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,733 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,733 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,733 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:51,733 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:51,733 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,734 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b89f4262e34dfdd1fbea3661f9d50263, disabling compactions & flushes 2018-05-02 06:29:51,734 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:29:51,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:51,752 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=26 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,762 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:29:51,762 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:29:51,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:29:51,763 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,763 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,763 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 06:29:51,763 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 670f6b815d2acac905130e5440d59304, disabling compactions & flushes 2018-05-02 06:29:51,763 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:29:51,763 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:29:51,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12204.seqid, newMaxSeqId=12204, maxSeqId=12202 2018-05-02 06:29:51,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11995.seqid, newMaxSeqId=11995, maxSeqId=11993 2018-05-02 06:29:51,788 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,788 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,788 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,788 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:29:51,788 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:29:51,789 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,789 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 960276b77c021b3663429298ac0cccd7, disabling compactions & flushes 2018-05-02 06:29:51,789 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:29:51,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,791 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:29:51,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:29:51,791 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 1bf9126ca1d7eb9abb934165d5f25857, disabling compactions & flushes 2018-05-02 06:29:51,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:29:51,815 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 06:29:51,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,818 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:29:51,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:29:51,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:51,818 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing a6d67b9eb3447b55a82b542d202ddd20, disabling compactions & flushes 2018-05-02 06:29:51,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:29:51,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,822 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:29:51,823 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:29:51,823 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,823 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 963add1708f89627737d4d216f3449df, disabling compactions & flushes 2018-05-02 06:29:51,823 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:29:51,836 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:51,838 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/12534.seqid, newMaxSeqId=12534, maxSeqId=12532 2018-05-02 06:29:51,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,840 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:29:51,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:29:51,841 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 4c37ee7a4e1210e481debdc2933fc4d2, disabling compactions & flushes 2018-05-02 06:29:51,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:29:51,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,842 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:29:51,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:29:51,843 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 681566c13ee68fa7a27c4bd39d5a79e0, disabling compactions & flushes 2018-05-02 06:29:51,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:29:51,863 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12247.seqid, newMaxSeqId=12247, maxSeqId=12245 2018-05-02 06:29:51,865 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:51,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,868 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:29:51,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:29:51,868 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing a3403d29839e289caca7a1e3c5cd71be, disabling compactions & flushes 2018-05-02 06:29:51,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:29:51,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,870 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:29:51,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:29:51,870 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 06:29:51,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:29:51,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12433.seqid, newMaxSeqId=12433, maxSeqId=12431 2018-05-02 06:29:51,886 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:51,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,888 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:29:51,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:29:51,888 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 93a15c4ca6299bea02a86ac40494d75a, disabling compactions & flushes 2018-05-02 06:29:51,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:29:51,889 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,889 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,889 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,889 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:29:51,889 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:29:51,890 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing bae4cdead31e3a4da5b719f67722e3d8, disabling compactions & flushes 2018-05-02 06:29:51,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:29:51,913 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=5 2018-05-02 06:29:51,915 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12352.seqid, newMaxSeqId=12352, maxSeqId=12350 2018-05-02 06:29:51,916 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,916 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,916 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,917 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:29:51,917 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:29:51,917 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,917 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a0792481dc7d859b1b63b04bf9adad81, disabling compactions & flushes 2018-05-02 06:29:51,917 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:29:51,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,918 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:29:51,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:29:51,918 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,919 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 98abf1ead3bf61c95cc4ffe5e6e5fe96, disabling compactions & flushes 2018-05-02 06:29:51,919 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Running close preflush of {}98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:29:51,919 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.98 MB memstore heap size=30.61 MB 2018-05-02 06:29:51,941 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11962.seqid, newMaxSeqId=11962, maxSeqId=11960 2018-05-02 06:29:51,944 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,944 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,944 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,944 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:29:51,945 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:29:51,945 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,945 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 06:29:51,945 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:29:51,961 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13228.seqid, newMaxSeqId=13228, maxSeqId=13226 2018-05-02 06:29:51,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,965 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:29:51,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:29:51,965 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing cdf5d5c10fe0b7d279387a401c3754ca, disabling compactions & flushes 2018-05-02 06:29:51,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:29:51,989 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:51,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,993 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:29:51,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:29:51,993 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,994 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing c078deb2474e9c19b85b5fdb9efaa47d, disabling compactions & flushes 2018-05-02 06:29:51,994 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:29:52,010 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11361.seqid, newMaxSeqId=11361, maxSeqId=11359 2018-05-02 06:29:52,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,013 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:29:52,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:29:52,014 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,014 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 29fe0b7866912efc70bb3f2d7fd83059, disabling compactions & flushes 2018-05-02 06:29:52,014 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:29:52,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12763.seqid, newMaxSeqId=12763, maxSeqId=12761 2018-05-02 06:29:52,031 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,031 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,031 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,031 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:29:52,031 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:29:52,031 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 298977e880ecf479f4c50be95a5e8eb5, disabling compactions & flushes 2018-05-02 06:29:52,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:29:52,047 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:52,051 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,051 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,051 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,051 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:29:52,051 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:29:52,051 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 24479666cac01319b99b1d0e11484b5c, disabling compactions & flushes 2018-05-02 06:29:52,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:29:52,081 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:52,086 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=14.29 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/.tmp/f1/fa1b12403a784e7a919dcbe2533a2a5f 2018-05-02 06:29:52,091 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,091 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,091 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,091 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:29:52,092 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:29:52,093 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 411bd5dbc3845cf91c0d9f4649c84b86, disabling compactions & flushes 2018-05-02 06:29:52,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:29:52,130 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12597.seqid, newMaxSeqId=12597, maxSeqId=12595 2018-05-02 06:29:52,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,135 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,135 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,135 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:29:52,135 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:29:52,136 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,136 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 06:29:52,136 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:29:52,157 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/.tmp/f1/fa1b12403a784e7a919dcbe2533a2a5f as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1/fa1b12403a784e7a919dcbe2533a2a5f 2018-05-02 06:29:52,159 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12246.seqid, newMaxSeqId=12246, maxSeqId=12244 2018-05-02 06:29:52,162 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,162 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,163 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:29:52,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:29:52,163 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 06:29:52,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:29:52,179 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1/fa1b12403a784e7a919dcbe2533a2a5f, entries=256374, sequenceid=404, filesize=14.1 M 2018-05-02 06:29:52,183 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~14.29 MB/14980048, heap size ~31.26 MB/32773464, currentsize=0 B/0 for 3f187e06c01ee258024c3bcea437345b in 468ms, sequenceid=404, compaction requested=false 2018-05-02 06:29:52,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:29:52,191 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12785.seqid, newMaxSeqId=12785, maxSeqId=12783 2018-05-02 06:29:52,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,199 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:29:52,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:29:52,200 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 93f2d602c0a0a654856fb16863c2ff38, disabling compactions & flushes 2018-05-02 06:29:52,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:29:52,205 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:29:52,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,209 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:29:52,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:29:52,210 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 3ea52812fafc49b1651e26e1bd43ec97, disabling compactions & flushes 2018-05-02 06:29:52,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:29:52,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:52,238 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:52,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,240 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:29:52,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:29:52,241 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 93aea36f9251cfe49e28f84a517e3630, disabling compactions & flushes 2018-05-02 06:29:52,242 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:29:52,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:29:52,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:29:52,242 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing bc0d9cf47453518915ae21d2cf637c18, disabling compactions & flushes 2018-05-02 06:29:52,242 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Running close preflush of {}bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:29:52,242 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.92 MB memstore heap size=30.47 MB 2018-05-02 06:29:52,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:52,438 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,438 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,438 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,438 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:29:52,438 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:29:52,439 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,439 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 06:29:52,439 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:29:52,467 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11532.seqid, newMaxSeqId=11532, maxSeqId=11530 2018-05-02 06:29:52,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,472 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:29:52,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:29:52,472 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,473 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 9f9b6704233f2d2e06a5634fda7f94ca, disabling compactions & flushes 2018-05-02 06:29:52,473 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:29:52,505 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:52,510 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,510 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,510 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,510 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:29:52,510 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:29:52,510 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,511 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 06:29:52,511 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:29:52,553 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/71.seqid, newMaxSeqId=71, maxSeqId=68 2018-05-02 06:29:52,559 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,559 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,559 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,560 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:29:52,560 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:29:52,560 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,560 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 06:29:52,560 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:29:52,582 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.98 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/.tmp/f1/90df418002ae42479d76f78c99ff2a2a 2018-05-02 06:29:52,624 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12722.seqid, newMaxSeqId=12722, maxSeqId=12720 2018-05-02 06:29:52,626 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/.tmp/f1/90df418002ae42479d76f78c99ff2a2a as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1/90df418002ae42479d76f78c99ff2a2a 2018-05-02 06:29:52,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 11 regions to close 2018-05-02 06:29:52,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,633 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:29:52,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:29:52,634 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,634 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing b9be42c9bb7b350e67325f3e6a3a59fb, disabling compactions & flushes 2018-05-02 06:29:52,634 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:29:52,668 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1/90df418002ae42479d76f78c99ff2a2a, entries=251047, sequenceid=404, filesize=13.9 M 2018-05-02 06:29:52,670 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~13.98 MB/14661856, heap size ~30.61 MB/32092504, currentsize=0 B/0 for 98abf1ead3bf61c95cc4ffe5e6e5fe96 in 751ms, sequenceid=404, compaction requested=false 2018-05-02 06:29:52,670 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:29:52,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:52,683 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,683 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,684 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,684 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:29:52,684 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:29:52,684 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing bb19a5bd59b1b3dff86020949234aaf5, disabling compactions & flushes 2018-05-02 06:29:52,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Running close preflush of {}bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:29:52,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=14.44 MB memstore heap size=31.60 MB 2018-05-02 06:29:52,701 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:29:52,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,705 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:29:52,706 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:29:52,706 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,706 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing e1d84fe7eb9adbf61fec50c75876bce8, disabling compactions & flushes 2018-05-02 06:29:52,706 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:29:52,726 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:52,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,729 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:29:52,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:29:52,730 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing f61045f3bb8866c33d9b05635d777d75, disabling compactions & flushes 2018-05-02 06:29:52,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:29:52,748 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:52,751 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,751 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,751 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,752 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:29:52,752 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:29:52,752 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,752 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing a8ff96226d546f0ea151823ae73e5a1b, disabling compactions & flushes 2018-05-02 06:29:52,752 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:29:52,798 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11459.seqid, newMaxSeqId=11459, maxSeqId=11457 2018-05-02 06:29:52,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,803 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:29:52,804 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:29:52,804 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,804 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b91e4798ff3d5547c13242b7b77e2f63, disabling compactions & flushes 2018-05-02 06:29:52,804 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:29:52,824 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:52,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,828 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:29:52,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:29:52,828 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,829 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 41c625158570994727f1c92a8606ca6c, disabling compactions & flushes 2018-05-02 06:29:52,829 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Running close preflush of {}41c625158570994727f1c92a8606ca6c 2018-05-02 06:29:52,829 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.92 MB memstore heap size=30.48 MB 2018-05-02 06:29:52,924 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.92 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/.tmp/f1/738c9260ad314f638f9a79ce7621a39e 2018-05-02 06:29:52,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/.tmp/f1/738c9260ad314f638f9a79ce7621a39e as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1/738c9260ad314f638f9a79ce7621a39e 2018-05-02 06:29:52,960 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1/738c9260ad314f638f9a79ce7621a39e, entries=249941, sequenceid=404, filesize=13.8 M 2018-05-02 06:29:52,962 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Finished memstore flush; data size ~13.92 MB/14593672, heap size ~30.47 MB/31951128, currentsize=0 B/0 for bc0d9cf47453518915ae21d2cf637c18 in 720ms, sequenceid=404, compaction requested=false 2018-05-02 06:29:52,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:52,989 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:29:52,992 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,993 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:52,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:52,993 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 06:29:52,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:29:53,009 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12800.seqid, newMaxSeqId=12800, maxSeqId=12798 2018-05-02 06:29:53,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:53,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:53,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:53,013 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:29:53,014 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:29:53,082 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=14.44 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/.tmp/f1/295233e1f4a34156ae67883afcf73774 2018-05-02 06:29:53,100 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/.tmp/f1/295233e1f4a34156ae67883afcf73774 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1/295233e1f4a34156ae67883afcf73774 2018-05-02 06:29:53,116 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1/295233e1f4a34156ae67883afcf73774, entries=259188, sequenceid=404, filesize=14.3 M 2018-05-02 06:29:53,118 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Finished memstore flush; data size ~14.44 MB/15138816, heap size ~31.60 MB/33133272, currentsize=0 B/0 for bb19a5bd59b1b3dff86020949234aaf5 in 433ms, sequenceid=404, compaction requested=false 2018-05-02 06:29:53,118 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:29:53,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:29:53,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:53,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:53,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:53,142 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:29:53,143 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:29:53,228 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.92 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/.tmp/f1/01824852ca574c54a2a33f4964ca59ec 2018-05-02 06:29:53,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/.tmp/f1/01824852ca574c54a2a33f4964ca59ec as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1/01824852ca574c54a2a33f4964ca59ec 2018-05-02 06:29:53,257 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1/01824852ca574c54a2a33f4964ca59ec, entries=249998, sequenceid=404, filesize=13.8 M 2018-05-02 06:29:53,260 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~13.92 MB/14593672, heap size ~30.48 MB/31958424, currentsize=0 B/0 for 41c625158570994727f1c92a8606ca6c in 431ms, sequenceid=404, compaction requested=false 2018-05-02 06:29:53,260 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:29:53,273 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:29:53,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:53,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:53,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:53,276 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:29:53,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:29:53,430 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391; all regions closed. 2018-05-02 06:29:53,431 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:29:53,450 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:29:53,450 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525241227391:(num 1525241252682) 2018-05-02 06:29:53,450 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:29:53,452 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 06:29:53,452 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:29:53,453 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:29:53,453 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:29:53,453 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:29:53,453 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:29:53,458 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 06:29:53,458 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:29:53,458 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:29:53,481 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:29:53,481 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009f, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:29:53,584 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x2631f08d939009f closed 2018-05-02 06:29:53,584 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:29:53,584 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391; zookeeper connection closed. 2018-05-02 06:29:53,585 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:29:53,586 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:30:14 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:30:16,293 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:30:16,295 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:30:16,295 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:30:16,295 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:30:16,295 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:30:16,847 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:30:16,847 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:30:16,847 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:30:16,847 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:30:16,849 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:30:16,849 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:30:16,849 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:30:16,849 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:30:16,849 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:30:16,849 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:30:16,849 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:30:16,850 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020630 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:30:16,851 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:30:16,852 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:30:16,853 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:30:16,854 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020630 2018-05-02 06:30:16,854 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:30:16,854 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:30:16,854 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:30:16,855 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:30:16,855 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:30:16,855 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:30:16,855 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:30:16,855 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:30:16,855 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:30:16,858 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:30:16,859 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020630, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:30:17,053 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:30:17,783 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:30:17,895 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:30:18,583 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:30:18,589 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:30:19,158 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:30:19,158 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:30:19,158 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:30:19,350 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:30:19,572 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:30:19,572 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:30:19,604 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:30:19,948 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 06:30:19,973 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:30:19,976 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:30:19,977 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:30:19,977 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:30:19,977 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:30:19,978 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:30:20,390 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:30:20,666 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:30:20,696 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:30:20,838 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 06:30:21,161 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:30:21,164 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:30:21,166 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:30:21,181 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:21,185 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:21,190 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:30:24,514 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:30:24,537 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:30:24,635 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:30:24,645 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:30:24,645 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:30:24,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:30:24,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:30:24,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:30:24,646 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:30:24,646 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:30:24,646 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:30:24,646 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:30:24,646 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:30:24,647 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:30:24,647 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:30:24,647 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:30:24,647 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:30:24,647 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:30:24,648 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:30:24,711 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:30:24,717 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:30:24,749 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:30:24 UTC 2018 2018-05-02 06:30:24,750 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:30:24 UTC 2018 2018-05-02 06:30:24,750 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:11:41 UTC 2018 2018-05-02 06:30:24,757 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:30:24,785 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:30:24,806 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:30:24,819 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900c3, negotiated timeout = 90000 2018-05-02 06:30:24,823 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:30:24,825 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3 connected 2018-05-02 06:30:24,896 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:30:25,029 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:30:25,029 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:30:25,030 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:30:25,030 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:30:25,030 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:30:25,030 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:30:25,030 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:30:25,031 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:30:25,031 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:30:25,031 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:30:25,039 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:30:25,209 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:30:25,233 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:30:25,233 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:30:25,272 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:30:25,309 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:30:25,447 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:30:25,448 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:30:25,448 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:30:25,488 INFO [main] util.log: Logging initialized @9963ms 2018-05-02 06:30:25,605 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:30:25,624 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:30:25,624 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:30:25,628 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:30:25,628 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:30:25,628 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:30:25,671 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:30:25,673 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:30:25,785 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:30:25,786 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:30:26,005 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:30:26,011 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:30:26,026 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:30:26,026 INFO [main] server.Server: Started @10501ms 2018-05-02 06:30:26,056 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:30:26,062 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:30:26,086 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:30:26,086 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:30:26,092 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:30:26,121 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x3f26caea to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:30:26,131 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3f26caea] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1262880223@e4492d3 2018-05-02 06:30:26,133 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3f26caea-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:30:26,135 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3f26caea-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:30:26,135 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3f26caea-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:30:26,138 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3f26caea-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900c4, negotiated timeout = 90000 2018-05-02 06:30:26,184 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ffc1842, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:30:26,186 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@791bace1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:0 2018-05-02 06:30:26,192 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000008:16020 2018-05-02 06:30:26,205 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:30:26,205 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:30:26,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:30:26,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:30:26,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:30:26,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:30:26,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:30:26,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:30:26,226 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:30:26,226 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:30:26,226 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:30:26,226 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:30:26,226 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:30:26,226 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:30:26,410 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:30:26,414 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:30:26,420 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:30:26,420 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:30:26,424 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:30:26,425 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:30:26,479 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:30:26,479 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:30:26,479 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:30:26,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:30:26,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:30:26,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:30:26,492 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:30:26,493 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:30:26,493 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:30:26,493 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:30:26,493 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:30:26,493 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:30:26,494 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:30:26,494 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:30:26,494 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:30:26,503 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:30:26,503 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:30:26,503 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:30:26,503 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:30:26,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:30:26,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:30:26,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:30:26,668 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:30:26,668 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:30:26,668 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:30:26,668 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:30:26,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:30:26,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:30:26,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:30:26,679 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:30:26,679 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:30:26,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:30:26,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:30:26,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:30:26,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:30:26,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:30:26,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:30:26,682 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:30:26,682 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:30:26,682 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:30:26,683 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:30:26,686 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:30:26,686 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:30:26,686 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:30:26,687 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:30:26,687 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:30:26,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:30:26,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:30:26,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:30:26,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:30:26,697 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:30:26,697 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:30:26,697 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:30:26,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:30:26,709 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:30:26,710 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:30:26,988 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:30:27,464 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:30:29,604 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:29,609 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:30:30,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:30:30,428 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:30:30,429 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:30:30,429 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:30:30,436 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:30:30,437 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:30:30,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525241326264 with port=16020, startcode=1525242616896 2018-05-02 06:30:30,708 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:30:30,709 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:30:30,710 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:30:30,884 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:30:30,901 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:30:30,955 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:30:30,959 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:30:30,960 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:30:30,961 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:30:30,961 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:30:31,024 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:30:31,025 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:30:31,025 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:30:31,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:30:31,110 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:30:31,426 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:30:31,451 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:30:31,518 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:30:31,534 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:30:31,539 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:30:31,570 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:30:31,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:30:31,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:30:31,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:30:31,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:30:31,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:30:31,626 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:30:31,626 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:30:31,629 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:30:31,950 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 starting 2018-05-02 06:30:31,952 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:30:31,956 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:30:31,963 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:30:32,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:30:32,038 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:30:32,053 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896] 2018-05-02 06:30:32,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x3631f08b27900c3 2018-05-02 06:30:32,112 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:30:32,112 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:30:32,112 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896' 2018-05-02 06:30:32,112 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:30:32,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:30:32,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:30:32,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:30:32,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:30:32,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896' 2018-05-02 06:30:32,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:30:32,125 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:30:32,126 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:30:32,126 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:30:32,126 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:30:35,222 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:30:36,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 671 ms, current pipeline: [] 2018-05-02 06:30:36,047 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.1525242635223 2018-05-02 06:30:36,047 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 06:31:26,163 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3f26caea] zookeeper.ZooKeeper: Session: 0x3631f08b27900c4 closed 2018-05-02 06:31:26,163 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3f26caea-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:31:30,269 DEBUG [RS-EventLoopGroup-1-3] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:31:31,861 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:31:31,864 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:31:33,271 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:31:36,274 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:31:36,274 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:31:36,274 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:31:36,472 DEBUG [RS-EventLoopGroup-1-5] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:31:36,483 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:31:36,492 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:31:36,493 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:31:36,496 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:31:36,497 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:31:36,497 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:32:06,604 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:32:08,721 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:32:09,608 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:32:09,610 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 06:32:09,765 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:32:12,813 DEBUG [RS-EventLoopGroup-1-8] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:32:12,822 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:32:13,063 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:32:13,064 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:32:13,066 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:32:13,066 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:32:13,067 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:32:40,463 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:32:40,481 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 znode expired, triggering replicatorRemoved event 2018-05-02 06:32:40,484 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:32:46,504 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:32:46,506 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:32:46,512 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:32:46,525 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:32:46,526 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:32:46,526 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/10 2018-05-02 06:32:46,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:32:52,122 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:32:52,126 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:32:52,126 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:52,133 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:32:52,145 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:52,149 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:32:52,150 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:52,151 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:32:52,152 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:32:52,262 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:32:52,452 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:32:52,453 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:32:52,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 70ed82a86a0f0c62d692e8ffd1c0f904, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:32:52,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 530aabaf92e988eadd5338ed38b9be0c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:32:52,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AuthenticationService 2018-05-02 06:32:52,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AuthenticationService 2018-05-02 06:32:52,555 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:52,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:52,560 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=SecureBulkLoadService 2018-05-02 06:32:52,561 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:52,561 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:52,561 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:52,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AccessControlService 2018-05-02 06:32:52,562 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:52,562 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:52,569 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=SecureBulkLoadService 2018-05-02 06:32:52,569 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:52,569 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:52,569 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:52,569 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AccessControlService 2018-05-02 06:32:52,570 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:52,570 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:52,574 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:32:52,581 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:32:52,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 06:32:52,582 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:52,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 06:32:52,582 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:52,582 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:52,598 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:52,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 06:32:52,599 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:52,599 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:52,610 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 06:32:52,610 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:32:52,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:32:52,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:32:52,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:32:52,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:32:52,639 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:52,644 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:52,645 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:52,650 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:32:52,999 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:32:53,932 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:32:53,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 46af8f9145c39f07531ceaa92c7f8dbc, NAME => 'test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:32:53,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AuthenticationService 2018-05-02 06:32:53,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=SecureBulkLoadService 2018-05-02 06:32:53,934 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,934 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AccessControlService 2018-05-02 06:32:53,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:32:53,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:32:53,936 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,938 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:32:53,938 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 24479666cac01319b99b1d0e11484b5c, NAME => 'test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 06:32:53,938 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:32:53,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AuthenticationService 2018-05-02 06:32:53,939 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:32:53,939 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=SecureBulkLoadService 2018-05-02 06:32:53,939 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,939 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,939 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 83a4166017315b69b94bd868d994447b, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 06:32:53,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AccessControlService 2018-05-02 06:32:53,939 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:32:53,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=AuthenticationService 2018-05-02 06:32:53,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=SecureBulkLoadService 2018-05-02 06:32:53,940 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,940 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,939 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:32:53,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 24479666cac01319b99b1d0e11484b5c 2018-05-02 06:32:53,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:32:53,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=AccessControlService 2018-05-02 06:32:53,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 06:32:53,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 06:32:53,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 83a4166017315b69b94bd868d994447b 2018-05-02 06:32:53,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:32:53,965 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,971 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 06:32:53,971 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 45aba4505046246827a28b03d1c2611e, NAME => 'test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:32:53,971 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,971 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:32:53,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 843b3b66a19c1c2d494720e99edc9c52, NAME => 'test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:32:53,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:32:53,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AuthenticationService 2018-05-02 06:32:53,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=SecureBulkLoadService 2018-05-02 06:32:53,973 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,973 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 8cb8f1e8202d0fae01b5300bd7c59bcb, NAME => 'test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:32:53,975 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:32:53,975 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AuthenticationService 2018-05-02 06:32:53,975 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,975 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=SecureBulkLoadService 2018-05-02 06:32:53,975 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,975 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,975 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AccessControlService 2018-05-02 06:32:53,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AccessControlService 2018-05-02 06:32:53,976 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,976 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AuthenticationService 2018-05-02 06:32:53,976 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => f3ccd3e0671152671071dbba3e2cb560, NAME => 'test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:32:53,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=SecureBulkLoadService 2018-05-02 06:32:53,976 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,976 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,976 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,977 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AccessControlService 2018-05-02 06:32:53,977 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AuthenticationService 2018-05-02 06:32:53,977 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=SecureBulkLoadService 2018-05-02 06:32:53,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:32:53,978 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,978 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:32:53,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AccessControlService 2018-05-02 06:32:53,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,979 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,979 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:32:53,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:32:53,980 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,980 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,980 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,980 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:32:53,981 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:32:53,981 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,981 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,982 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,982 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 45aba4505046246827a28b03d1c2611e 2018-05-02 06:32:53,982 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:32:53,985 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:54,011 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => b03e6835fbab67365568f0d2520e68de, NAME => 'test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 06:32:54,011 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AuthenticationService 2018-05-02 06:32:54,011 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:54,012 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=SecureBulkLoadService 2018-05-02 06:32:54,012 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:54,012 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:54,012 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:54,012 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AccessControlService 2018-05-02 06:32:54,014 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:54,014 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:54,014 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b03e6835fbab67365568f0d2520e68de 2018-05-02 06:32:54,014 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:32:54,017 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:54,085 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1 2018-05-02 06:32:54,085 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1 2018-05-02 06:32:54,086 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:32:54,086 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:32:54,089 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:32:54,089 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:32:54,090 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:32:54,090 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:32:54,091 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 06:32:54,091 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 06:32:54,091 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:32:54,092 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:32:54,100 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:32:54,100 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:32:54,100 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:32:54,101 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:32:54,104 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:32:54,104 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:32:54,115 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:32:54,115 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:32:54,118 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:32:54,118 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:32:54,119 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:32:54,119 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:32:54,150 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,151 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,152 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,153 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,153 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,153 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,153 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,154 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,154 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,156 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,164 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,164 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:54,244 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,244 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,245 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,246 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,247 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,249 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,250 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,251 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,252 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,253 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,256 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,258 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,518 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/0acb18db6bda4706bbcda3af69f23a7f 2018-05-02 06:32:54,518 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 06:32:54,518 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1/1aee01e3c8c44a4b8875ca610e35934d 2018-05-02 06:32:54,518 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 06:32:54,518 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1/76ab8edd7657482f8dbe68fd37422b11 2018-05-02 06:32:54,518 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1/8d2cf3534de147ed904b9fc82a8f2b3b 2018-05-02 06:32:54,518 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1/21db71a596184e8987d3b0a857d2a3d8 2018-05-02 06:32:54,518 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9183f33444af4ba4b0488cd21989a0e1 2018-05-02 06:32:54,518 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf/0a4f5f73439447d58ac2371e0ea69f1f 2018-05-02 06:32:54,523 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,523 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,523 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,523 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,523 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,524 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,523 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,528 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1/feeed6316aa4472a883749a8aeb53dd3 2018-05-02 06:32:54,528 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,530 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/3f2d2f80200b4e7086e08019eff91a27 2018-05-02 06:32:54,532 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/2c6b0a92ce6e4b29b4f5e46b400fa68f 2018-05-02 06:32:54,569 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:32:54,570 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:32:54,573 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:32:54,577 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:32:54,579 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,584 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:32:54,597 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:32:54,597 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/11 2018-05-02 06:32:54,598 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:32:54,607 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9ca70b0c41a14a7db0a7b4b70bd83580 2018-05-02 06:32:54,608 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:32:54,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:32:54,643 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:32:54,643 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:32:54,644 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de 2018-05-02 06:32:54,644 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b 2018-05-02 06:32:54,644 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:32:54,645 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 06:32:54,649 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/4fedc898e84f4979967e3b8666fea966 2018-05-02 06:32:54,649 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,652 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/c96bbf08131a49779b97ac2c5c0843ad 2018-05-02 06:32:54,652 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,654 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 2018-05-02 06:32:54,658 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 znode expired, triggering replicatorRemoved event 2018-05-02 06:32:54,658 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:32:54,659 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e 2018-05-02 06:32:54,662 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/649450abe53e433192b35544d0e0ab96 2018-05-02 06:32:54,662 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,695 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c 2018-05-02 06:32:54,695 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:32:54,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:32:54,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:54,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:32:54,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12246.seqid, newMaxSeqId=12246, maxSeqId=12245 2018-05-02 06:32:54,755 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:32:54,756 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12803.seqid, newMaxSeqId=12803, maxSeqId=12802 2018-05-02 06:32:54,757 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:32:54,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12465.seqid, newMaxSeqId=12465, maxSeqId=12464 2018-05-02 06:32:54,759 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:54,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:54,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:54,761 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened b03e6835fbab67365568f0d2520e68de; next sequenceid=420 2018-05-02 06:32:54,768 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:32:54,768 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 843b3b66a19c1c2d494720e99edc9c52; next sequenceid=417 2018-05-02 06:32:54,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=12246 2018-05-02 06:32:54,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 70ed82a86a0f0c62d692e8ffd1c0f904; next sequenceid=411 2018-05-02 06:32:54,770 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened f3ccd3e0671152671071dbba3e2cb560; next sequenceid=12803 2018-05-02 06:32:54,770 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 83a4166017315b69b94bd868d994447b; next sequenceid=411 2018-05-02 06:32:54,770 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12465 2018-05-02 06:32:54,771 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:32:54,771 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 46af8f9145c39f07531ceaa92c7f8dbc; next sequenceid=420 2018-05-02 06:32:54,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 24479666cac01319b99b1d0e11484b5c; next sequenceid=420 2018-05-02 06:32:54,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 8cb8f1e8202d0fae01b5300bd7c59bcb; next sequenceid=420 2018-05-02 06:32:54,781 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 45aba4505046246827a28b03d1c2611e; next sequenceid=423 2018-05-02 06:32:54,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 530aabaf92e988eadd5338ed38b9be0c; next sequenceid=414 2018-05-02 06:32:54,844 INFO [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:32:54,844 INFO [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:32:54,844 INFO [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:32:54,844 INFO [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:32:54,846 INFO [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:32:54,849 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:32:54,850 INFO [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:32:54,850 INFO [PostOpenDeployTasks:83a4166017315b69b94bd868d994447b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:32:54,851 INFO [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:32:54,853 INFO [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:32:54,854 INFO [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:32:54,853 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:32:54,885 DEBUG [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:32:54,885 DEBUG [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:32:54,886 DEBUG [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:32:54,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,894 DEBUG [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:32:54,894 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,894 DEBUG [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:32:54,894 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,895 DEBUG [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:32:54,895 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,907 DEBUG [PostOpenDeployTasks:83a4166017315b69b94bd868d994447b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:32:54,907 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,908 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:32:54,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,908 DEBUG [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:32:54,909 DEBUG [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:32:54,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,909 DEBUG [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:32:54,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:54,910 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:32:54,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,220 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:32:55,239 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:32:55,240 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 4c37ee7a4e1210e481debdc2933fc4d2, NAME => 'test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 06:32:55,240 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AuthenticationService 2018-05-02 06:32:55,241 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,241 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=SecureBulkLoadService 2018-05-02 06:32:55,241 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,241 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,241 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,241 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AccessControlService 2018-05-02 06:32:55,241 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,242 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,242 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 06:32:55,242 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:32:55,242 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,248 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:32:55,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => b7a376d86459306e108ed5a76373661f, NAME => 'test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f.', STARTKEY => '\xC3^P\xD7\x945\xE4\xF2', ENDKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C'} 2018-05-02 06:32:55,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=AuthenticationService 2018-05-02 06:32:55,251 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,251 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=SecureBulkLoadService 2018-05-02 06:32:55,252 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,252 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,252 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,252 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=AccessControlService 2018-05-02 06:32:55,252 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,252 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,253 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b7a376d86459306e108ed5a76373661f 2018-05-02 06:32:55,253 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:32:55,253 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,282 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:32:55,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => a0792481dc7d859b1b63b04bf9adad81, NAME => 'test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:32:55,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AuthenticationService 2018-05-02 06:32:55,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=SecureBulkLoadService 2018-05-02 06:32:55,283 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,283 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AccessControlService 2018-05-02 06:32:55,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0792481dc7d859b1b63b04bf9adad81 2018-05-02 06:32:55,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:32:55,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,294 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 06:32:55,294 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 06:32:55,295 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,296 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,307 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:32:55,307 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => e8edde5a00b30c080b02d1b096794b39, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39.', STARTKEY => '\xC3^P\xD7\x945\xE4\xF2', ENDKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C'} 2018-05-02 06:32:55,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AuthenticationService 2018-05-02 06:32:55,308 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1 2018-05-02 06:32:55,308 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1 2018-05-02 06:32:55,308 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=SecureBulkLoadService 2018-05-02 06:32:55,308 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,308 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,308 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AccessControlService 2018-05-02 06:32:55,309 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,309 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,309 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:32:55,309 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:32:55,310 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,310 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,311 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,311 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:32:55,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 84e1f06e5813d24f1cc300fb32167710, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:32:55,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 36261edb1d6e5ae1d91cf96e60680ebc, NAME => 'test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc.', STARTKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF', ENDKEY => ''} 2018-05-02 06:32:55,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=AuthenticationService 2018-05-02 06:32:55,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=AuthenticationService 2018-05-02 06:32:55,318 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,318 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=SecureBulkLoadService 2018-05-02 06:32:55,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=SecureBulkLoadService 2018-05-02 06:32:55,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=AccessControlService 2018-05-02 06:32:55,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=AccessControlService 2018-05-02 06:32:55,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,320 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,320 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 84e1f06e5813d24f1cc300fb32167710 2018-05-02 06:32:55,320 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:32:55,320 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 36261edb1d6e5ae1d91cf96e60680ebc 2018-05-02 06:32:55,320 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:32:55,320 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,320 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,342 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 06:32:55,342 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 06:32:55,343 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,344 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,378 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf/719182bd2f5b43a9b5002dd5ebd23549 2018-05-02 06:32:55,379 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,399 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:32:55,401 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1 2018-05-02 06:32:55,401 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1 2018-05-02 06:32:55,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 06:32:55,402 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,403 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,432 DEBUG [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/f1 2018-05-02 06:32:55,432 DEBUG [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/f1 2018-05-02 06:32:55,433 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:32:55,433 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:32:55,435 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,435 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,436 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,437 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,449 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,453 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. 2018-05-02 06:32:55,453 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 5fc7cfd582bc270c530fe9787011078c, NAME => 'test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 06:32:55,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AuthenticationService 2018-05-02 06:32:55,454 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=SecureBulkLoadService 2018-05-02 06:32:55,455 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,455 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,455 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,455 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AccessControlService 2018-05-02 06:32:55,455 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,455 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,456 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5fc7cfd582bc270c530fe9787011078c 2018-05-02 06:32:55,456 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:32:55,456 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,461 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1/bae67c56562a4bec8f7072dec02c91fa 2018-05-02 06:32:55,461 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,475 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:32:55,475 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf/273e08be6b9245749007d7ffc22c666d 2018-05-02 06:32:55,475 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 041977f7087dd987f3bc1c3b0d191155, NAME => 'test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:32:55,475 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AuthenticationService 2018-05-02 06:32:55,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => f0e2ef89aaf5b6c921cae75dc420616f, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f.', STARTKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A', ENDKEY => '\x0DyC^P\xD7\x944'} 2018-05-02 06:32:55,476 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=SecureBulkLoadService 2018-05-02 06:32:55,476 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,476 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. service=AuthenticationService 2018-05-02 06:32:55,476 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,477 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. service=SecureBulkLoadService 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AccessControlService 2018-05-02 06:32:55,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,477 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:32:55,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 9c4d77e622ed44a126e39f057f044750, NAME => 'test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750.', STARTKEY => '\xA1\xAF(k\xCA\x1A\xF2p', ENDKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A'} 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. service=AccessControlService 2018-05-02 06:32:55,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 166b9a4d8133a32343e23907c3228d62, NAME => 'test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:32:55,478 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AuthenticationService 2018-05-02 06:32:55,478 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode f0e2ef89aaf5b6c921cae75dc420616f 2018-05-02 06:32:55,478 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,478 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. 2018-05-02 06:32:55,478 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AuthenticationService 2018-05-02 06:32:55,478 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=SecureBulkLoadService 2018-05-02 06:32:55,478 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,478 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,478 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=SecureBulkLoadService 2018-05-02 06:32:55,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AccessControlService 2018-05-02 06:32:55,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AccessControlService 2018-05-02 06:32:55,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 9c4d77e622ed44a126e39f057f044750 2018-05-02 06:32:55,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:32:55,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 166b9a4d8133a32343e23907c3228d62 2018-05-02 06:32:55,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:32:55,480 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,480 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc 2018-05-02 06:32:55,500 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81 2018-05-02 06:32:55,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f 2018-05-02 06:32:55,512 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1/55f6b92d148746a78237d661d14075ef 2018-05-02 06:32:55,512 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,521 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:32:55,521 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:32:55,521 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:32:55,521 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:32:55,524 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:32:55,524 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:32:55,525 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,526 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,552 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 06:32:55,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12254.seqid, newMaxSeqId=12254, maxSeqId=12253 2018-05-02 06:32:55,552 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 06:32:55,554 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,555 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,555 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:32:55,555 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:32:55,556 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 06:32:55,556 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 06:32:55,556 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,557 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,557 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1/977dea08c07d4c3986cb36260a1abca4 2018-05-02 06:32:55,557 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,557 DEBUG [StoreOpener-f0e2ef89aaf5b6c921cae75dc420616f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/f0e2ef89aaf5b6c921cae75dc420616f/f1 2018-05-02 06:32:55,557 DEBUG [StoreOpener-f0e2ef89aaf5b6c921cae75dc420616f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/f0e2ef89aaf5b6c921cae75dc420616f/f1 2018-05-02 06:32:55,557 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,557 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,561 INFO [StoreOpener-f0e2ef89aaf5b6c921cae75dc420616f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,563 INFO [StoreOpener-f0e2ef89aaf5b6c921cae75dc420616f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710 2018-05-02 06:32:55,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:32:55,606 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 4c37ee7a4e1210e481debdc2933fc4d2; next sequenceid=12254 2018-05-02 06:32:55,612 INFO [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:32:55,623 DEBUG [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:32:55,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,645 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1/abd14eb0366d49d6b1f9c4e3beb7ea22 2018-05-02 06:32:55,645 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11966.seqid, newMaxSeqId=11966, maxSeqId=11965 2018-05-02 06:32:55,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=10 2018-05-02 06:32:55,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62 2018-05-02 06:32:55,669 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened a0792481dc7d859b1b63b04bf9adad81; next sequenceid=11966 2018-05-02 06:32:55,669 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 36261edb1d6e5ae1d91cf96e60680ebc; next sequenceid=11 2018-05-02 06:32:55,673 DEBUG [StoreOpener-f0e2ef89aaf5b6c921cae75dc420616f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/f0e2ef89aaf5b6c921cae75dc420616f/f1/0f2f848cbc3949ec874b5f0b301b5fe2 2018-05-02 06:32:55,673 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/94cb8f2a93da4c488fdc446518fd1cc5 2018-05-02 06:32:55,673 INFO [StoreOpener-f0e2ef89aaf5b6c921cae75dc420616f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,674 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1/f62905fc6764413996ad23803ef34639 2018-05-02 06:32:55,674 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:32:55,678 INFO [PostOpenDeployTasks:36261edb1d6e5ae1d91cf96e60680ebc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:32:55,678 INFO [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:32:55,681 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1/fc387eb319f242cba0384b0a240bb24d 2018-05-02 06:32:55,681 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,688 DEBUG [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:32:55,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,689 DEBUG [PostOpenDeployTasks:36261edb1d6e5ae1d91cf96e60680ebc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:32:55,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,698 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened b7a376d86459306e108ed5a76373661f; next sequenceid=417 2018-05-02 06:32:55,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:32:55,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:32:55,702 INFO [PostOpenDeployTasks:b7a376d86459306e108ed5a76373661f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:32:55,709 DEBUG [PostOpenDeployTasks:b7a376d86459306e108ed5a76373661f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:32:55,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/f0e2ef89aaf5b6c921cae75dc420616f 2018-05-02 06:32:55,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750 2018-05-02 06:32:55,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:32:55,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened e8edde5a00b30c080b02d1b096794b39; next sequenceid=411 2018-05-02 06:32:55,722 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 84e1f06e5813d24f1cc300fb32167710; next sequenceid=414 2018-05-02 06:32:55,726 INFO [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:32:55,728 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/dbd2816429b24832a77a1b06377230f4 2018-05-02 06:32:55,728 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,729 INFO [PostOpenDeployTasks:84e1f06e5813d24f1cc300fb32167710] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:32:55,732 DEBUG [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:32:55,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,736 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c 2018-05-02 06:32:55,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:32:55,744 DEBUG [PostOpenDeployTasks:84e1f06e5813d24f1cc300fb32167710] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:32:55,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,746 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 166b9a4d8133a32343e23907c3228d62; next sequenceid=423 2018-05-02 06:32:55,749 INFO [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:32:55,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:55,761 DEBUG [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:32:55,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/f0e2ef89aaf5b6c921cae75dc420616f/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:32:55,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:32:55,765 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 041977f7087dd987f3bc1c3b0d191155; next sequenceid=420 2018-05-02 06:32:55,773 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened f0e2ef89aaf5b6c921cae75dc420616f; next sequenceid=414 2018-05-02 06:32:55,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 9c4d77e622ed44a126e39f057f044750; next sequenceid=423 2018-05-02 06:32:55,775 INFO [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:32:55,779 INFO [PostOpenDeployTasks:f0e2ef89aaf5b6c921cae75dc420616f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. 2018-05-02 06:32:55,779 INFO [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:32:55,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:55,786 DEBUG [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:32:55,786 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,788 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 5fc7cfd582bc270c530fe9787011078c; next sequenceid=420 2018-05-02 06:32:55,789 DEBUG [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:32:55,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,790 DEBUG [PostOpenDeployTasks:f0e2ef89aaf5b6c921cae75dc420616f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. 2018-05-02 06:32:55,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:55,794 INFO [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:32:55,799 DEBUG [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:32:55,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:32:56,757 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@356f0911 2018-05-02 06:32:56,760 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:32:56,762 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:32:56,762 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:32:56,766 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d93900c4, negotiated timeout = 10000 2018-05-02 06:32:56,822 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:32:56,832 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:32:57,610 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:32:57,612 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:32:57,614 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:32:58,122 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:32:58,456 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:32:58,456 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:32:58,509 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:32:58,509 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:32:58,510 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:32:58,514 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:32:58,517 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:32:58,517 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:32:59,593 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:59,593 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:32:59,594 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:59,594 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:32:59,595 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:59,595 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:33:00,416 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 2018-05-02 06:33:00,419 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 znode expired, triggering replicatorRemoved event 2018-05-02 06:33:00,419 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:33:01,692 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:33:01,707 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:33:01,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:33:01,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 06:33:01,708 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 06:33:01,708 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,708 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,708 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 06:33:01,709 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,709 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:33:01,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:33:01,709 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,726 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:33:01,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 6e9424b67ac115dc3547de9b3eb4c5ef, NAME => 'test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:33:01,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AuthenticationService 2018-05-02 06:33:01,726 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:33:01,727 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:33:01,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=SecureBulkLoadService 2018-05-02 06:33:01,727 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,727 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AccessControlService 2018-05-02 06:33:01,727 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 06:33:01,728 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,729 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:33:01,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,737 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:33:01,737 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:33:01,737 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => cb06832d0afac8a9bdbe1f92ad565ab6, NAME => 'test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 963add1708f89627737d4d216f3449df, NAME => 'test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AuthenticationService 2018-05-02 06:33:01,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AuthenticationService 2018-05-02 06:33:01,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=SecureBulkLoadService 2018-05-02 06:33:01,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. service=AccessControlService 2018-05-02 06:33:01,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 963add1708f89627737d4d216f3449df 2018-05-02 06:33:01,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:33:01,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=SecureBulkLoadService 2018-05-02 06:33:01,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AccessControlService 2018-05-02 06:33:01,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 06:33:01,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:33:01,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,754 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 06:33:01,754 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 06:33:01,755 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,755 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,758 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 06:33:01,758 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 06:33:01,759 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,760 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,760 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:33:01,760 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 06:33:01,760 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf 2018-05-02 06:33:01,760 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:33:01,760 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:33:01,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 5de3546305c82231844eb840c6cfa983, NAME => 'test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:33:01,761 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:33:01,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 06:33:01,761 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 06:33:01,761 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:33:01,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => b52f5cecdefd18652f3e796b8dada29f, NAME => 'test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f.', STARTKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E', ENDKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8'} 2018-05-02 06:33:01,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => b32f7e3b20e736fd1681093bef6b435d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:33:01,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=AuthenticationService 2018-05-02 06:33:01,762 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=SecureBulkLoadService 2018-05-02 06:33:01,762 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,762 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,762 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,763 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:33:01,763 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:33:01,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 6cfc24cc3a423e0969138ce2a69be99e, NAME => 'test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 06:33:01,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AuthenticationService 2018-05-02 06:33:01,764 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=SecureBulkLoadService 2018-05-02 06:33:01,764 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,764 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,764 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AccessControlService 2018-05-02 06:33:01,765 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,765 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:33:01,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:33:01,766 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,767 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:33:01,772 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:33:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:33:01,773 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 682775c01c8d957d744ae2b280c815cd, NAME => 'test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:33:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:33:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:33:01,773 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => b8144dc37f351e256653e1454207538f, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:33:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:33:01,773 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AuthenticationService 2018-05-02 06:33:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:33:01,773 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:33:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:33:01,774 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:33:01,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AuthenticationService 2018-05-02 06:33:01,774 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=AccessControlService 2018-05-02 06:33:01,775 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,775 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,775 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 06:33:01,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=SecureBulkLoadService 2018-05-02 06:33:01,775 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b32f7e3b20e736fd1681093bef6b435d 2018-05-02 06:33:01,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:33:01,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AuthenticationService 2018-05-02 06:33:01,776 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,776 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,776 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 8ac6e5d607af84df53c95bd38a03c313, NAME => 'test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313.', STARTKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C', ENDKEY => '\xD0\xD7\x945\xE5\x0Dy&'} 2018-05-02 06:33:01,777 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,777 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=AuthenticationService 2018-05-02 06:33:01,777 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => cdf5d5c10fe0b7d279387a401c3754ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca.', STARTKEY => '\x86\xBC\xA1\xAF(k\xCA\x08', ENDKEY => '\x8DyC^P\xD7\x94"'} 2018-05-02 06:33:01,777 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,777 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=AuthenticationService 2018-05-02 06:33:01,777 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 385c8f00672f754fa0d7448f5ac543fa, NAME => 'test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa.', STARTKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0', ENDKEY => 'r\x86\xBC\xA1\xAF(k\xBA'} 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => dc953453430fbf031584084fad7c31bd, NAME => 'test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AuthenticationService 2018-05-02 06:33:01,778 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AuthenticationService 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=SecureBulkLoadService 2018-05-02 06:33:01,778 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=SecureBulkLoadService 2018-05-02 06:33:01,778 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,778 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,778 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => b91e4798ff3d5547c13242b7b77e2f63, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:33:01,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=AccessControlService 2018-05-02 06:33:01,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=AuthenticationService 2018-05-02 06:33:01,779 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,779 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => da9e02fc1fdd80392463141e6bc6cf96, NAME => 'test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 06:33:01,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AuthenticationService 2018-05-02 06:33:01,779 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=SecureBulkLoadService 2018-05-02 06:33:01,780 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,780 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 670f6b815d2acac905130e5440d59304, NAME => 'test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 06:33:01,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:33:01,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AuthenticationService 2018-05-02 06:33:01,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 06:33:01,780 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,780 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=SecureBulkLoadService 2018-05-02 06:33:01,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 06:33:01,781 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,781 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,781 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AccessControlService 2018-05-02 06:33:01,781 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,781 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,774 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:33:01,781 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,781 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,780 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 8ac6e5d607af84df53c95bd38a03c313 2018-05-02 06:33:01,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:33:01,779 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=SecureBulkLoadService 2018-05-02 06:33:01,782 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,782 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,782 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=AccessControlService 2018-05-02 06:33:01,782 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:33:01,782 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,783 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:33:01,783 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:33:01,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 06:33:01,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 06:33:01,783 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,783 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 06:33:01,784 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,784 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:33:01,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=SecureBulkLoadService 2018-05-02 06:33:01,784 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,784 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AccessControlService 2018-05-02 06:33:01,784 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,778 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,785 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,777 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=SecureBulkLoadService 2018-05-02 06:33:01,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:33:01,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=SecureBulkLoadService 2018-05-02 06:33:01,785 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,785 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase dc953453430fbf031584084fad7c31bd 2018-05-02 06:33:01,785 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:33:01,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AccessControlService 2018-05-02 06:33:01,785 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,786 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,786 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,786 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5de3546305c82231844eb840c6cfa983 2018-05-02 06:33:01,786 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:33:01,786 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:33:01,775 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,787 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:33:01,787 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AccessControlService 2018-05-02 06:33:01,787 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,787 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AuthenticationService 2018-05-02 06:33:01,788 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=SecureBulkLoadService 2018-05-02 06:33:01,788 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,788 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,788 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AccessControlService 2018-05-02 06:33:01,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=SecureBulkLoadService 2018-05-02 06:33:01,787 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,789 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,789 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,789 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 06:33:01,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:33:01,789 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,789 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:33:01,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:33:01,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,787 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,791 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AccessControlService 2018-05-02 06:33:01,791 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,791 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,786 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,785 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,791 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,791 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=AccessControlService 2018-05-02 06:33:01,792 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,792 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:33:01,785 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AccessControlService 2018-05-02 06:33:01,792 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,792 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,781 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 06:33:01,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 670f6b815d2acac905130e5440d59304 2018-05-02 06:33:01,792 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:33:01,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AccessControlService 2018-05-02 06:33:01,793 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:33:01,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:33:01,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,795 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,796 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,799 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1 2018-05-02 06:33:01,800 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1 2018-05-02 06:33:01,803 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,804 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:33:01,804 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:33:01,812 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,812 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,812 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,812 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,812 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,813 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b8144dc37f351e256653e1454207538f 2018-05-02 06:33:01,813 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:33:01,813 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,814 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 682775c01c8d957d744ae2b280c815cd 2018-05-02 06:33:01,814 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:33:01,814 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,815 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:33:01,815 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:33:01,815 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b91e4798ff3d5547c13242b7b77e2f63 2018-05-02 06:33:01,815 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:33:01,815 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,815 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,815 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 385c8f00672f754fa0d7448f5ac543fa 2018-05-02 06:33:01,816 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:33:01,816 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,815 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode cdf5d5c10fe0b7d279387a401c3754ca 2018-05-02 06:33:01,816 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:33:01,817 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,822 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/6cba47e832104f3da47cbb23a9bc05f2 2018-05-02 06:33:01,822 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 06:33:01,823 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,824 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,831 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,831 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,856 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:33:01,862 DEBUG [StoreOpener-963add1708f89627737d4d216f3449df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/test_cf/54a9c57c931f4c86bdd73ac84c990e67 2018-05-02 06:33:01,862 INFO [StoreOpener-963add1708f89627737d4d216f3449df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,866 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1 2018-05-02 06:33:01,866 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1 2018-05-02 06:33:01,866 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,867 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:33:01,894 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 06:33:01,894 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 06:33:01,895 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,895 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:33:01,895 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:33:01,895 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 06:33:01,895 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 06:33:01,993 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,993 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,994 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,998 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,999 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,999 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:33:01,999 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:33:02,000 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:33:02,000 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:33:02,000 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2 2018-05-02 06:33:02,000 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df 2018-05-02 06:33:02,000 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,002 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1 2018-05-02 06:33:02,002 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1 2018-05-02 06:33:02,002 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 06:33:02,002 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 06:33:02,002 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,002 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:33:02,002 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:33:02,002 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1 2018-05-02 06:33:02,002 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1 2018-05-02 06:33:02,002 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,003 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,003 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,003 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,003 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,003 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,004 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,004 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,004 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,005 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,005 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,005 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 06:33:02,005 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 06:33:02,006 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,007 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,007 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:33:02,007 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:33:02,008 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:33:02,008 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:33:02,009 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,009 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,021 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:33:02,031 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/75a153d8f4a240b1ac387295522fdac6 2018-05-02 06:33:02,031 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,031 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf/cd508c6396b04928b56ea073a30af8a5 2018-05-02 06:33:02,031 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,034 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:33:02,034 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:33:02,035 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,036 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,054 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:33:02,066 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:33:02,075 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 06:33:02,075 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 06:33:02,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 06:33:02,089 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/60b614564dba4b2ebef91378bb1169f6 2018-05-02 06:33:02,102 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1/7e7819a9ed7b4762a10d8bb24cd6d15a 2018-05-02 06:33:02,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:33:02,127 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:33:02,127 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:33:02,127 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:33:02,131 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:33:02,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:33:02,136 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf/f5f702b4ca0c43be911590949f4eda41 2018-05-02 06:33:02,137 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,136 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf/3dabedf14f6c4208ad17e7be0d53907d 2018-05-02 06:33:02,137 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,138 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1/20cc702a3aaf4197b9dd17722b21fc36 2018-05-02 06:33:02,138 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,139 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf/d830ee103d2b41e0ad35903c835935d7 2018-05-02 06:33:02,139 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,148 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1/c0a6bd8873ac486db9e40f6c058b5bcd 2018-05-02 06:33:02,148 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12474.seqid, newMaxSeqId=12474, maxSeqId=12473 2018-05-02 06:33:02,158 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1/a22fbfb1317a4c1493bae2cc0fc84cec 2018-05-02 06:33:02,158 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,164 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/12538.seqid, newMaxSeqId=12538, maxSeqId=12537 2018-05-02 06:33:02,165 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa 2018-05-02 06:33:02,165 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/2634850b34ea44e88f4b0d654c593d82 2018-05-02 06:33:02,168 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf/5524750f28964bae9802836f5884fdd1 2018-05-02 06:33:02,168 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,168 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1/4ad7c958e814455ea328234413e3e47e 2018-05-02 06:33:02,168 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,170 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd 2018-05-02 06:33:02,171 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304 2018-05-02 06:33:02,175 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/aca5a68c0e414fe7b1239ba0d951dc5f 2018-05-02 06:33:02,175 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 06:33:02,175 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,175 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1/5c55ea585a374e61ae2ef341de1c0c88 2018-05-02 06:33:02,175 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,175 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,176 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=12474 2018-05-02 06:33:02,178 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd 2018-05-02 06:33:02,179 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 963add1708f89627737d4d216f3449df; next sequenceid=12538 2018-05-02 06:33:02,181 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:33:02,184 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:33:02,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983 2018-05-02 06:33:02,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca 2018-05-02 06:33:02,188 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 06:33:02,188 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 06:33:02,190 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:33:02,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,199 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 26d4b78c3c7d2fdea4d32bb21a3ca5fe, NAME => 'test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 06:33:02,199 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AuthenticationService 2018-05-02 06:33:02,199 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=SecureBulkLoadService 2018-05-02 06:33:02,200 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,200 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,200 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AccessControlService 2018-05-02 06:33:02,200 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,201 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 06:33:02,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:33:02,201 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,203 INFO [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:33:02,209 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d 2018-05-02 06:33:02,210 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:33:02,211 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63 2018-05-02 06:33:02,211 DEBUG [PostOpenDeployTasks:963add1708f89627737d4d216f3449df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:33:02,211 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:33:02,212 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1/952e6e0835fe40d8bf53e29e592d158c 2018-05-02 06:33:02,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 06:33:02,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 06:33:02,212 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,212 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 06:33:02,213 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,213 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:33:02,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:33:02,214 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,214 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12897.seqid, newMaxSeqId=12897, maxSeqId=12896 2018-05-02 06:33:02,218 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:33:02,225 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:02,226 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened cb06832d0afac8a9bdbe1f92ad565ab6; next sequenceid=12897 2018-05-02 06:33:02,230 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/b9fd06c3a1d143b3955e7818940543a8 2018-05-02 06:33:02,230 INFO [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:33:02,230 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,231 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12254.seqid, newMaxSeqId=12254, maxSeqId=12253 2018-05-02 06:33:02,234 DEBUG [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:33:02,234 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,235 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1bf9126ca1d7eb9abb934165d5f25857, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:33:02,235 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AuthenticationService 2018-05-02 06:33:02,235 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,235 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=SecureBulkLoadService 2018-05-02 06:33:02,235 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,236 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,236 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,236 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AccessControlService 2018-05-02 06:33:02,236 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,236 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,236 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:33:02,236 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:33:02,237 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,251 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 6cfc24cc3a423e0969138ce2a69be99e; next sequenceid=12254 2018-05-02 06:33:02,252 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 6e9424b67ac115dc3547de9b3eb4c5ef; next sequenceid=420 2018-05-02 06:33:02,268 INFO [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:33:02,269 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11466.seqid, newMaxSeqId=11466, maxSeqId=11465 2018-05-02 06:33:02,271 INFO [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:33:02,274 DEBUG [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:33:02,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,275 DEBUG [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:33:02,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313 2018-05-02 06:33:02,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 084aa7d8a3bd4d7483494d5a2c39d5df, NAME => 'test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:33:02,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 28608f50f9f828e7d3ab571a72b0d5f3, NAME => 'test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:33:02,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AuthenticationService 2018-05-02 06:33:02,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AuthenticationService 2018-05-02 06:33:02,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=SecureBulkLoadService 2018-05-02 06:33:02,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=SecureBulkLoadService 2018-05-02 06:33:02,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AccessControlService 2018-05-02 06:33:02,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AccessControlService 2018-05-02 06:33:02,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 06:33:02,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:33:02,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:33:02,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:33:02,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f 2018-05-02 06:33:02,305 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11466 2018-05-02 06:33:02,305 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:33:02,305 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:33:02,306 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,306 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,309 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 385c8f00672f754fa0d7448f5ac543fa; next sequenceid=417 2018-05-02 06:33:02,314 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:33:02,314 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:33:02,315 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 06:33:02,315 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 06:33:02,316 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,316 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,316 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:33:02,316 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:33:02,317 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,319 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,319 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,322 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 06:33:02,322 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 06:33:02,322 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,322 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,323 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,328 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12211.seqid, newMaxSeqId=12211, maxSeqId=12210 2018-05-02 06:33:02,330 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12760.seqid, newMaxSeqId=12760, maxSeqId=12759 2018-05-02 06:33:02,330 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:33:02,331 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:02,331 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12511.seqid, newMaxSeqId=12511, maxSeqId=12510 2018-05-02 06:33:02,332 INFO [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:33:02,332 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:02,338 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:33:02,338 DEBUG [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:33:02,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 06:33:02,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => ab4e529620b9089675ab2d6f3446a39c, NAME => 'test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c.', STARTKEY => '\x86\xBC\xA1\xAF(k\xCA\x08', ENDKEY => '\x8DyC^P\xD7\x94"'} 2018-05-02 06:33:02,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 06:33:02,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AuthenticationService 2018-05-02 06:33:02,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 06:33:02,339 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,339 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 06:33:02,340 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,340 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 06:33:02,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:33:02,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=SecureBulkLoadService 2018-05-02 06:33:02,340 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,340 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,340 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AccessControlService 2018-05-02 06:33:02,341 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,341 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,341 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am ab4e529620b9089675ab2d6f3446a39c 2018-05-02 06:33:02,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:33:02,341 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,348 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 670f6b815d2acac905130e5440d59304; next sequenceid=12211 2018-05-02 06:33:02,349 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:02,350 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,350 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12330.seqid, newMaxSeqId=12330, maxSeqId=12329 2018-05-02 06:33:02,350 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:02,353 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:02,355 INFO [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:33:02,360 DEBUG [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:33:02,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:33:02,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 06:33:02,361 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 06:33:02,361 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,361 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,361 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 06:33:02,362 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,362 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,362 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:33:02,362 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:33:02,362 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,363 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened da9e02fc1fdd80392463141e6bc6cf96; next sequenceid=12760 2018-05-02 06:33:02,364 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12696.seqid, newMaxSeqId=12696, maxSeqId=12695 2018-05-02 06:33:02,368 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened cdf5d5c10fe0b7d279387a401c3754ca; next sequenceid=420 2018-05-02 06:33:02,368 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 682775c01c8d957d744ae2b280c815cd; next sequenceid=12511 2018-05-02 06:33:02,374 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11893.seqid, newMaxSeqId=11893, maxSeqId=11892 2018-05-02 06:33:02,381 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened b52f5cecdefd18652f3e796b8dada29f; next sequenceid=420 2018-05-02 06:33:02,383 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 5de3546305c82231844eb840c6cfa983; next sequenceid=420 2018-05-02 06:33:02,384 INFO [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:33:02,385 INFO [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:33:02,387 INFO [PostOpenDeployTasks:cdf5d5c10fe0b7d279387a401c3754ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:33:02,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,390 INFO [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:33:02,396 DEBUG [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:33:02,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,396 INFO [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:33:02,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => bb19a5bd59b1b3dff86020949234aaf5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:33:02,396 DEBUG [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:33:02,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 299ab8318d1b1d267135f988608683b7, NAME => 'test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 06:33:02,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AuthenticationService 2018-05-02 06:33:02,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AuthenticationService 2018-05-02 06:33:02,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=SecureBulkLoadService 2018-05-02 06:33:02,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,397 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,397 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=SecureBulkLoadService 2018-05-02 06:33:02,397 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,397 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AccessControlService 2018-05-02 06:33:02,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,398 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AccessControlService 2018-05-02 06:33:02,398 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,398 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,398 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 299ab8318d1b1d267135f988608683b7 2018-05-02 06:33:02,398 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:33:02,399 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,400 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,400 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:33:02,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:33:02,401 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,401 DEBUG [PostOpenDeployTasks:cdf5d5c10fe0b7d279387a401c3754ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:33:02,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 51119cebc42546d1c9f2590eec5a49b3, NAME => 'test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:33:02,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AuthenticationService 2018-05-02 06:33:02,402 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=SecureBulkLoadService 2018-05-02 06:33:02,402 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,402 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,402 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,403 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AccessControlService 2018-05-02 06:33:02,403 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,403 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,403 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:33:02,403 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:33:02,403 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,408 DEBUG [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:33:02,408 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,408 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 1fa0746104343e63d4a6c982f8a3bf32, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 06:33:02,409 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AuthenticationService 2018-05-02 06:33:02,409 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,409 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=SecureBulkLoadService 2018-05-02 06:33:02,409 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,409 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,409 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 8ac6e5d607af84df53c95bd38a03c313; next sequenceid=423 2018-05-02 06:33:02,409 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,410 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AccessControlService 2018-05-02 06:33:02,410 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,410 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,410 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=12330 2018-05-02 06:33:02,410 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:33:02,410 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:33:02,410 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened b32f7e3b20e736fd1681093bef6b435d; next sequenceid=417 2018-05-02 06:33:02,410 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,411 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=11893 2018-05-02 06:33:02,411 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened dc953453430fbf031584084fad7c31bd; next sequenceid=12696 2018-05-02 06:33:02,411 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened b91e4798ff3d5547c13242b7b77e2f63; next sequenceid=420 2018-05-02 06:33:02,413 DEBUG [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:33:02,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 3ea52812fafc49b1651e26e1bd43ec97, NAME => 'test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 06:33:02,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AuthenticationService 2018-05-02 06:33:02,415 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,415 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=SecureBulkLoadService 2018-05-02 06:33:02,415 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,415 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,415 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,415 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AccessControlService 2018-05-02 06:33:02,415 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,415 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,416 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 06:33:02,416 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:33:02,418 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened b8144dc37f351e256653e1454207538f; next sequenceid=417 2018-05-02 06:33:02,418 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:33:02,418 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,423 INFO [PostOpenDeployTasks:8ac6e5d607af84df53c95bd38a03c313] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:33:02,423 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 06:33:02,423 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 06:33:02,424 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,425 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,425 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:33:02,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => f61045f3bb8866c33d9b05635d777d75, NAME => 'test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:33:02,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AuthenticationService 2018-05-02 06:33:02,430 DEBUG [PostOpenDeployTasks:8ac6e5d607af84df53c95bd38a03c313] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:33:02,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=SecureBulkLoadService 2018-05-02 06:33:02,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 735c68afadbe039ceafe7e37c71a82b8, NAME => 'test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:33:02,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AuthenticationService 2018-05-02 06:33:02,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=SecureBulkLoadService 2018-05-02 06:33:02,431 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,431 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,436 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,439 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,439 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AccessControlService 2018-05-02 06:33:02,440 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,440 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,440 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AccessControlService 2018-05-02 06:33:02,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:33:02,441 INFO [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:33:02,441 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:33:02,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:33:02,441 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,441 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:33:02,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:33:02,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,445 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 06:33:02,445 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 06:33:02,446 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,447 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,447 INFO [PostOpenDeployTasks:b32f7e3b20e736fd1681093bef6b435d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:33:02,450 INFO [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:33:02,451 INFO [PostOpenDeployTasks:b91e4798ff3d5547c13242b7b77e2f63] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:33:02,452 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:33:02,453 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:33:02,453 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,454 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,455 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 06:33:02,461 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,476 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 06:33:02,476 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 06:33:02,478 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:33:02,478 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:33:02,478 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,479 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,479 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,482 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,491 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf/8206d33252364d01b7ddcb8a35cf4b14 2018-05-02 06:33:02,491 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf/9f7cb69b6abe4f57bb56248fe3e04156 2018-05-02 06:33:02,491 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,491 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,497 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf/6a8aa66cb5364117a56e66c694e2a7f7 2018-05-02 06:33:02,497 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,501 DEBUG [PostOpenDeployTasks:b32f7e3b20e736fd1681093bef6b435d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:33:02,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,502 DEBUG [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:33:02,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:33:02,502 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:33:02,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,509 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 06:33:02,510 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,510 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 06:33:02,510 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,510 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,510 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,510 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 06:33:02,511 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,511 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,511 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:33:02,511 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:33:02,511 DEBUG [PostOpenDeployTasks:b91e4798ff3d5547c13242b7b77e2f63] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:33:02,511 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,512 DEBUG [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:33:02,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,514 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1/39f70bcc389446a6a85d27019cee494f 2018-05-02 06:33:02,515 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,515 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,516 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:33:02,534 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:33:02,534 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:33:02,534 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:33:02,534 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:33:02,535 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 06:33:02,535 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:33:02,535 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 06:33:02,535 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,535 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:33:02,536 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,537 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,536 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,538 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,538 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,543 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,544 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:33:02,547 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 06:33:02,548 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:33:02,548 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:33:02,548 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,549 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,553 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:33:02,553 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:33:02,556 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 06:33:02,556 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,556 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,558 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,564 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/2a4d0a4a276a427f956af1d693600d04 2018-05-02 06:33:02,569 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:33:02,570 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 06:33:02,595 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1/295233e1f4a34156ae67883afcf73774 2018-05-02 06:33:02,597 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,602 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 06:33:02,606 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf/9cc15af02af041c9bb1530abdde14636 2018-05-02 06:33:02,606 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,611 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 06:33:02,612 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,699 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/fbf50f6c80344b5190d76c6ce3b8f375 2018-05-02 06:33:02,699 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,703 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1/2c27a1bafac241928300cca4169c9f94 2018-05-02 06:33:02,703 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:33:02,720 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1/d53deff6e1564e7f9a4b4dcf2158aa82 2018-05-02 06:33:02,720 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,722 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:33:02,723 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7 2018-05-02 06:33:02,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12795.seqid, newMaxSeqId=12795, maxSeqId=12794 2018-05-02 06:33:02,742 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 06:33:02,742 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/23f180c1403c423b8d56e773059b77f3 2018-05-02 06:33:02,745 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/07854b903e5c4a14aab13c9789d93907 2018-05-02 06:33:02,755 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,759 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12795 2018-05-02 06:33:02,760 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/7f6cc973fc9141ee84218d1cf4abc1f2 2018-05-02 06:33:02,771 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 06:33:02,772 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:33:02,772 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c 2018-05-02 06:33:02,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12608.seqid, newMaxSeqId=12608, maxSeqId=12607 2018-05-02 06:33:02,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12034.seqid, newMaxSeqId=12034, maxSeqId=12033 2018-05-02 06:33:02,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:33:02,784 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:33:02,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,787 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 084aa7d8a3bd4d7483494d5a2c39d5df; next sequenceid=12608 2018-05-02 06:33:02,787 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12422.seqid, newMaxSeqId=12422, maxSeqId=12421 2018-05-02 06:33:02,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,797 INFO [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:33:02,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:33:02,804 DEBUG [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:33:02,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,817 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 28608f50f9f828e7d3ab571a72b0d5f3; next sequenceid=12034 2018-05-02 06:33:02,820 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 26d4b78c3c7d2fdea4d32bb21a3ca5fe; next sequenceid=12422 2018-05-02 06:33:02,828 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 1bf9126ca1d7eb9abb934165d5f25857; next sequenceid=417 2018-05-02 06:33:02,845 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/ad174b44a0ea459c97ae086ef4638f39 2018-05-02 06:33:02,845 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/d9d7b3335aed4b73b1949214243017d7 2018-05-02 06:33:02,848 INFO [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:33:02,854 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,856 DEBUG [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:33:02,856 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,858 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/d5ac413ba8334de5a72f01d06da0f43f 2018-05-02 06:33:02,858 INFO [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:33:02,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12807.seqid, newMaxSeqId=12807, maxSeqId=12806 2018-05-02 06:33:02,862 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,863 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,866 INFO [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:33:02,869 DEBUG [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:33:02,870 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:02,877 DEBUG [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:33:02,878 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,110 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12807 2018-05-02 06:33:03,117 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:33:03,118 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:33:03,118 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12309.seqid, newMaxSeqId=12309, maxSeqId=12308 2018-05-02 06:33:03,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:03,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12443.seqid, newMaxSeqId=12443, maxSeqId=12442 2018-05-02 06:33:03,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:33:03,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12309 2018-05-02 06:33:03,132 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:33:03,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12253.seqid, newMaxSeqId=12253, maxSeqId=12252 2018-05-02 06:33:03,134 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:03,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:03,137 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:33:03,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:03,139 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 299ab8318d1b1d267135f988608683b7; next sequenceid=12443 2018-05-02 06:33:03,140 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened bb19a5bd59b1b3dff86020949234aaf5; next sequenceid=414 2018-05-02 06:33:03,143 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=12253 2018-05-02 06:33:03,143 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:33:03,143 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,143 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 1fa0746104343e63d4a6c982f8a3bf32; next sequenceid=417 2018-05-02 06:33:03,146 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:33:03,146 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,147 INFO [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:33:03,148 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened ab4e529620b9089675ab2d6f3446a39c; next sequenceid=420 2018-05-02 06:33:03,151 DEBUG [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:33:03,151 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 3ea52812fafc49b1651e26e1bd43ec97; next sequenceid=417 2018-05-02 06:33:03,151 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,152 INFO [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:33:03,153 INFO [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:33:03,155 INFO [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:33:03,155 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:33:03,155 DEBUG [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:33:03,156 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,156 INFO [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:33:03,158 DEBUG [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:33:03,158 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,158 DEBUG [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:33:03,158 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,161 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:33:03,161 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,161 DEBUG [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:33:03,162 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,176 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:03,178 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:03,181 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 51119cebc42546d1c9f2590eec5a49b3; next sequenceid=420 2018-05-02 06:33:03,183 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 735c68afadbe039ceafe7e37c71a82b8; next sequenceid=423 2018-05-02 06:33:03,185 INFO [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:33:03,187 INFO [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:33:03,187 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:03,189 DEBUG [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:33:03,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,192 DEBUG [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:33:03,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:03,192 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened f61045f3bb8866c33d9b05635d777d75; next sequenceid=423 2018-05-02 06:33:03,195 INFO [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:33:03,199 DEBUG [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:33:03,199 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:06,710 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:33:06,712 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:33:06,715 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:33:07,223 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:33:07,524 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:33:07,524 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:33:07,607 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:33:07,607 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:33:07,607 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:33:07,616 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:33:07,619 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:33:07,619 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:33:11,165 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:11,166 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 znode expired, triggering replicatorRemoved event 2018-05-02 06:33:11,166 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:33:11,597 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:33:11,599 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:33:11,599 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,601 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:33:11,603 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,603 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:33:11,603 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,604 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:33:11,604 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:33:11,609 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:33:11,610 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:33:11,610 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,610 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 06:33:11,611 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:33:11,612 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:33:11,613 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,614 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:33:11,615 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,615 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:33:11,615 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:33:11,617 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:33:11,628 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 8816 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:59580 deadline: 1525242881627, exception=org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region hbase:meta,,1 is opening on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:11,628 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=18,queue=0,port=16020] ipc.RpcServer: callId: 1356 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:34096 deadline: 1525242881626, exception=org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region hbase:meta,,1 is opening on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:11,663 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta 2018-05-02 06:33:11,663 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 06:33:11,666 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:33:11,667 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 06:33:11,667 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:11,667 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 06:33:11,667 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:11,667 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:11,667 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:11,667 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 06:33:11,667 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:11,667 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:11,670 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 06:33:11,673 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 06:33:11,674 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 06:33:11,674 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 06:33:11,674 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 06:33:11,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:33:11,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:33:11,685 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:11,685 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:11,709 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/05aaed4155904938b4506f41d91511af 2018-05-02 06:33:11,735 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/8169341d68cd4062b78ea05353d96adb 2018-05-02 06:33:11,751 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d94dbfd81b8f43fe9bc92ec544ae2409 2018-05-02 06:33:11,751 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:11,757 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:33:11,757 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:33:11,757 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:11,758 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:11,780 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/1c4610df23af45aebb0c862393f196e4 2018-05-02 06:33:11,780 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:11,792 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 06:33:11,801 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 06:33:11,813 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/2739.seqid, newMaxSeqId=2739, maxSeqId=2738 2018-05-02 06:33:11,816 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=2739 2018-05-02 06:33:11,819 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 06:33:11,824 DEBUG [PostOpenDeployTasks:1588230740] regionserver.CompactSplit: Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:33:11,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:11,826 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 06:33:11,828 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 06:33:11,828 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:11,847 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 762980 starting at candidate #762980 after considering 1 permutations with 1 in ratio 2018-05-02 06:33:11,852 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] regionserver.HStore: 1588230740 - info: Initiating minor compaction (all files) 2018-05-02 06:33:11,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] regionserver.HRegion: Starting compaction of info in hbase:meta,,1.1588230740 2018-05-02 06:33:11,853 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/8169341d68cd4062b78ea05353d96adb, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/05aaed4155904938b4506f41d91511af, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d94dbfd81b8f43fe9bc92ec544ae2409] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=745.1 K 2018-05-02 06:33:11,856 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] compactions.Compactor: Compacting 8169341d68cd4062b78ea05353d96adb, keycount=2237, bloomtype=NONE, size=371.1 K, encoding=NONE, seqNum=2018, earliestPutTs=1525239672370 2018-05-02 06:33:11,858 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] compactions.Compactor: Compacting 05aaed4155904938b4506f41d91511af, keycount=1664, bloomtype=NONE, size=280.4 K, encoding=NONE, seqNum=2595, earliestPutTs=1525242508422 2018-05-02 06:33:11,860 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] compactions.Compactor: Compacting d94dbfd81b8f43fe9bc92ec544ae2409, keycount=536, bloomtype=NONE, size=93.6 K, encoding=NONE, seqNum=2735, earliestPutTs=1525242781451 2018-05-02 06:33:11,973 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:33:11,974 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:33:11,974 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,977 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:33:11,978 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,978 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:33:11,979 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:33:11,980 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:33:11,980 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:33:12,008 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,415 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] throttle.PressureAwareThroughputController: 1588230740#info#compaction#0 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 06:33:12,492 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:12,500 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:12,500 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 29fe0b7866912efc70bb3f2d7fd83059, NAME => 'test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:33:12,501 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AuthenticationService 2018-05-02 06:33:12,501 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,501 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=SecureBulkLoadService 2018-05-02 06:33:12,501 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,501 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,501 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AccessControlService 2018-05-02 06:33:12,503 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,503 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:33:12,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:12,504 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,508 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:12,508 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:33:12,509 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 06:33:12,509 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,509 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 06:33:12,509 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,509 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,509 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,509 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 06:33:12,509 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,510 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,510 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:33:12,510 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:12,510 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,535 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:12,535 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:33:12,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 06:33:12,536 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 06:33:12,536 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,536 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,536 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 06:33:12,537 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:33:12,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:12,539 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:33:12,539 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:33:12,540 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,540 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,544 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:12,544 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:33:12,544 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:33:12,544 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => a28a981dbde91491f904c000efc74ecb, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb.', STARTKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E', ENDKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8'} 2018-05-02 06:33:12,544 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 5c3fc4872d744c7bdc4c539ee55dc094, NAME => 'test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:33:12,545 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AuthenticationService 2018-05-02 06:33:12,545 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. service=AuthenticationService 2018-05-02 06:33:12,545 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,545 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,545 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=SecureBulkLoadService 2018-05-02 06:33:12,545 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. service=SecureBulkLoadService 2018-05-02 06:33:12,545 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,545 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,545 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,545 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,545 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,545 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,545 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AccessControlService 2018-05-02 06:33:12,545 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. service=AccessControlService 2018-05-02 06:33:12,545 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,545 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,545 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,545 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:33:12,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a28a981dbde91491f904c000efc74ecb 2018-05-02 06:33:12,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:12,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:12,546 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,546 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,547 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,547 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,547 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:12,555 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/608674def2b442d49e864e4c9256f9b8 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/608674def2b442d49e864e4c9256f9b8 2018-05-02 06:33:12,556 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:12,556 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 5080f353428ccd74e13d5b5493533655, NAME => 'atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:33:12,556 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:33:12,556 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 06:33:12,556 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AuthenticationService 2018-05-02 06:33:12,556 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,556 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,556 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=SecureBulkLoadService 2018-05-02 06:33:12,556 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 06:33:12,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,557 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:12,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,557 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,557 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AccessControlService 2018-05-02 06:33:12,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 06:33:12,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:33:12,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,557 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,557 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,557 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table atlas_janus 5080f353428ccd74e13d5b5493533655 2018-05-02 06:33:12,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:12,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 06:33:12,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:33:12,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 06:33:12,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:12,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 06:33:12,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:33:12,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:12,559 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,559 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:12,559 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => bae4cdead31e3a4da5b719f67722e3d8, NAME => 'test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:33:12,560 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AuthenticationService 2018-05-02 06:33:12,560 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,560 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=SecureBulkLoadService 2018-05-02 06:33:12,560 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,560 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,560 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,560 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AccessControlService 2018-05-02 06:33:12,560 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,560 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 06:33:12,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:12,561 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,562 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:12,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:33:12,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 06:33:12,562 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 06:33:12,563 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:12,563 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,563 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,563 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 06:33:12,563 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,563 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:33:12,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:12,564 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,572 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:33:12,572 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:33:12,573 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,574 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,575 DEBUG [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/f1 2018-05-02 06:33:12,575 DEBUG [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/f1 2018-05-02 06:33:12,576 INFO [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,577 INFO [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,578 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:33:12,578 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:33:12,579 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,580 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,580 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 06:33:12,580 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 06:33:12,581 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,583 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,583 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:12,584 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:12,584 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:12,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => c078deb2474e9c19b85b5fdb9efaa47d, NAME => 'test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:33:12,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 3b0ff50ae790418c1d7b36d704a3c7a8, NAME => 'test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:33:12,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AuthenticationService 2018-05-02 06:33:12,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:33:12,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AuthenticationService 2018-05-02 06:33:12,584 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,584 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=SecureBulkLoadService 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=SecureBulkLoadService 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:33:12,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AccessControlService 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AccessControlService 2018-05-02 06:33:12,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:33:12,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:33:12,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:33:12,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:33:12,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:12,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:12,586 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:12,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 06:33:12,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:12,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 06:33:12,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 06:33:12,587 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 06:33:12,587 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,587 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,587 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 06:33:12,587 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,588 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,588 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:33:12,588 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:12,588 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,589 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:12,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 47c574242e461d8e7a12972718bc27ff, NAME => 'test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:33:12,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AuthenticationService 2018-05-02 06:33:12,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=SecureBulkLoadService 2018-05-02 06:33:12,590 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,590 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AccessControlService 2018-05-02 06:33:12,591 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,591 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:33:12,591 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:33:12,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 47c574242e461d8e7a12972718bc27ff 2018-05-02 06:33:12,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:12,592 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,592 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,592 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,592 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:33:12,593 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:12,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => e75a388bc2011feed75bdc1a0e99a9a9, NAME => 'test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:33:12,593 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 06:33:12,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AuthenticationService 2018-05-02 06:33:12,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=SecureBulkLoadService 2018-05-02 06:33:12,594 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,594 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AccessControlService 2018-05-02 06:33:12,594 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => a0620fc83de532a37f6a9bb8f99cc6c4, NAME => 'test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:33:12,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 06:33:12,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:12,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AuthenticationService 2018-05-02 06:33:12,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=SecureBulkLoadService 2018-05-02 06:33:12,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,595 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,595 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AccessControlService 2018-05-02 06:33:12,595 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:33:12,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:12,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,595 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:33:12,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,603 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:12,605 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:33:12,605 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:33:12,605 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 3f187e06c01ee258024c3bcea437345b, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:33:12,605 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AuthenticationService 2018-05-02 06:33:12,605 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,605 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=SecureBulkLoadService 2018-05-02 06:33:12,605 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,605 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,605 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,605 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,606 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AccessControlService 2018-05-02 06:33:12,606 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,606 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,606 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,606 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3f187e06c01ee258024c3bcea437345b 2018-05-02 06:33:12,606 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:12,607 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,608 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:12,608 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 0fc1f394ae11e950c87a982abf7c1035, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:33:12,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AuthenticationService 2018-05-02 06:33:12,609 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=SecureBulkLoadService 2018-05-02 06:33:12,609 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,609 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,609 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AccessControlService 2018-05-02 06:33:12,609 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,610 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,610 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:33:12,610 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:12,610 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,613 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf/25e0a99365ef45e2b122cf95cdb0162d 2018-05-02 06:33:12,615 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:12,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 5bd8c2cd29520d0d27cacb48e7436a6d, NAME => 'test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:33:12,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AuthenticationService 2018-05-02 06:33:12,617 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,617 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=SecureBulkLoadService 2018-05-02 06:33:12,617 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,617 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,617 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,617 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AccessControlService 2018-05-02 06:33:12,618 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:12,618 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:12,618 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:12,618 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:12,620 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,620 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 06:33:12,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:12,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,626 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:12,636 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,642 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf/f50a0196e806447fb2330bc9b1168573 2018-05-02 06:33:12,642 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:33:12,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:33:12,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:33:12,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:33:12,663 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,663 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:33:12,663 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:33:12,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:12,664 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:12,664 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:12,665 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:12,668 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:12,670 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:33:12,670 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:33:12,671 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,672 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,679 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:33:12,679 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:33:12,680 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,680 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,682 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:33:12,682 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:33:12,682 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:33:12,683 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:33:12,684 DEBUG [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/f1/a0d64d2aee044a9a8aa5149ccef781a3 2018-05-02 06:33:12,684 INFO [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,685 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,686 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,688 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:33:12,690 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] regionserver.HStore: Completed compaction of 3 (all) file(s) in info of 1588230740 into 608674def2b442d49e864e4c9256f9b8(size=399.9 K), total size for store is 399.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 06:33:12,690 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:33:12,690 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:33:12,690 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=info, priority=7, startTime=1525242791823; duration=0sec 2018-05-02 06:33:12,691 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,691 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf/bc281d1814c14ba9aae3e3f6022e60f7 2018-05-02 06:33:12,692 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,692 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,692 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:33:12,692 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:33:12,692 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,693 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,693 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,693 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-shortCompactions-1525242791823] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:33:12,694 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:33:12,694 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:33:12,694 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,694 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,696 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 06:33:12,696 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 06:33:12,697 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,697 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:33:12,705 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:12,709 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:33:12,709 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:33:12,710 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,710 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:12,710 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:12,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => b89f4262e34dfdd1fbea3661f9d50263, NAME => 'hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:33:12,710 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:12,711 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:12,711 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AuthenticationService 2018-05-02 06:33:12,711 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:12,711 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=SecureBulkLoadService 2018-05-02 06:33:12,711 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:12,711 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,711 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,711 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AccessControlService 2018-05-02 06:33:12,711 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,711 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,711 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:33:12,712 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:33:12,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table acl b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:33:12,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:12,712 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,713 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,718 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 06:33:12,718 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 06:33:12,719 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,719 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,721 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 06:33:12,721 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,728 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:33:12,728 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:33:12,728 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,729 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,731 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:33:12,731 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:33:12,732 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for e: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,732 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 06:33:12,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb 2018-05-02 06:33:12,745 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:33:12,748 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 06:33:12,748 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,755 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:12,756 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:12,757 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:12,758 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:12,759 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:12,759 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:12,759 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:12,759 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:12,759 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:12,765 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf/0c830418052d48119c37552925d65824 2018-05-02 06:33:12,766 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 06:33:12,775 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,775 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,778 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:12,786 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:33:12,788 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1/bd1273938dfa4fcf838a564a80d2fa5b 2018-05-02 06:33:12,788 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,790 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1/f9a518867ce041a0b9932823647fbc93 2018-05-02 06:33:12,790 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,793 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:33:12,793 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:33:12,794 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=3, currentSize=173.77 KB, freeSize=204.63 MB, maxSize=204.80 MB, heapSize=173.77 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,794 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,800 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:33:12,805 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,808 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/210fc8ab70c74f0b94dd06fb92efaddb 2018-05-02 06:33:12,810 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:33:12,813 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf/e3402645d07644fb92ee0b1234e4c0d4 2018-05-02 06:33:12,813 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,821 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf/6120c78c262141868de3a5506d72ea0b 2018-05-02 06:33:12,821 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,822 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12773.seqid, newMaxSeqId=12773, maxSeqId=12772 2018-05-02 06:33:12,825 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1/fa1b12403a784e7a919dcbe2533a2a5f 2018-05-02 06:33:12,825 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,826 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:12,827 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:33:12,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13659.seqid, newMaxSeqId=13659, maxSeqId=13658 2018-05-02 06:33:12,830 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf/dae192f9264e44f1a0666db38941e7af 2018-05-02 06:33:12,830 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,842 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:33:12,844 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 29fe0b7866912efc70bb3f2d7fd83059; next sequenceid=12773 2018-05-02 06:33:12,845 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13659 2018-05-02 06:33:12,847 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 06:33:12,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 06:33:12,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:33:12,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 06:33:12,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:33:12,854 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:12,854 INFO [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:12,856 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:33:12,858 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 06:33:12,858 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,859 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:12,859 DEBUG [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:12,860 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:12,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => d5e9f3919d5e95ad2d6e01e1e16fa8ad, NAME => 'test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:33:12,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AuthenticationService 2018-05-02 06:33:12,861 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=SecureBulkLoadService 2018-05-02 06:33:12,861 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,861 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,861 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AccessControlService 2018-05-02 06:33:12,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,860 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:12,862 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:12,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 681566c13ee68fa7a27c4bd39d5a79e0, NAME => 'test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:33:12,862 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:12,862 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:12,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AuthenticationService 2018-05-02 06:33:12,862 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=SecureBulkLoadService 2018-05-02 06:33:12,862 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,863 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,863 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,863 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AccessControlService 2018-05-02 06:33:12,863 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:12,863 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,863 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:12,863 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,863 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:33:12,863 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:12,864 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,864 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/365f190e72194d82bee2f109d2425208 2018-05-02 06:33:12,864 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,865 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/12002.seqid, newMaxSeqId=12002, maxSeqId=12001 2018-05-02 06:33:12,866 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,866 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,866 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:33:12,867 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:12,867 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:12,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12200.seqid, newMaxSeqId=12200, maxSeqId=12199 2018-05-02 06:33:12,882 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/325853d0d9c94cb6ba31e4bcbf47843e 2018-05-02 06:33:12,883 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,884 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/38146263a2ae4ae69e1bcaf0e60354e4 2018-05-02 06:33:12,885 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=e, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b 2018-05-02 06:33:12,886 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=12002 2018-05-02 06:33:12,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:33:12,888 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12362.seqid, newMaxSeqId=12362, maxSeqId=12361 2018-05-02 06:33:12,889 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:33:12,890 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened a28a981dbde91491f904c000efc74ecb; next sequenceid=420 2018-05-02 06:33:12,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 5c3fc4872d744c7bdc4c539ee55dc094; next sequenceid=12200 2018-05-02 06:33:12,894 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:33:12,894 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,901 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:12,901 INFO [PostOpenDeployTasks:a28a981dbde91491f904c000efc74ecb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:12,901 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened bae4cdead31e3a4da5b719f67722e3d8; next sequenceid=12362 2018-05-02 06:33:12,902 INFO [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:12,903 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:33:12,904 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:33:12,904 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:33:12,905 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:12,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:33:12,905 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for f: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,906 DEBUG [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:12,906 DEBUG [PostOpenDeployTasks:a28a981dbde91491f904c000efc74ecb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:12,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 06:33:12,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:33:12,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 06:33:12,908 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 06:33:12,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,908 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 06:33:12,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 06:33:12,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 06:33:12,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 022c10bc256d7e8dc5d475d7ff8545ea, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:33:12,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AuthenticationService 2018-05-02 06:33:12,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,910 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=SecureBulkLoadService 2018-05-02 06:33:12,910 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,910 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:33:12,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:12,910 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AccessControlService 2018-05-02 06:33:12,910 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,910 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,910 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:33:12,910 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:33:12,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:12,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:12,911 INFO [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:12,912 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,914 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,917 DEBUG [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:12,917 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,917 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => bc0d9cf47453518915ae21d2cf637c18, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:33:12,917 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13417.seqid, newMaxSeqId=13417, maxSeqId=13416 2018-05-02 06:33:12,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AuthenticationService 2018-05-02 06:33:12,918 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=SecureBulkLoadService 2018-05-02 06:33:12,918 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,918 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,918 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AccessControlService 2018-05-02 06:33:12,919 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,919 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,919 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:33:12,919 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:12,920 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,923 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:33:12,923 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:33:12,925 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,925 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,926 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12807.seqid, newMaxSeqId=12807, maxSeqId=12806 2018-05-02 06:33:12,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:33:12,927 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13417 2018-05-02 06:33:12,932 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:12,932 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:12,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff 2018-05-02 06:33:12,934 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:33:12,934 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:33:12,935 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,935 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12807 2018-05-02 06:33:12,946 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:12,947 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,949 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 0fc1f394ae11e950c87a982abf7c1035; next sequenceid=414 2018-05-02 06:33:12,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 411bd5dbc3845cf91c0d9f4649c84b86, NAME => 'test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 06:33:12,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AuthenticationService 2018-05-02 06:33:12,950 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=SecureBulkLoadService 2018-05-02 06:33:12,950 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,950 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,950 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AccessControlService 2018-05-02 06:33:12,951 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 06:33:12,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:12,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,954 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:12,954 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11368.seqid, newMaxSeqId=11368, maxSeqId=11367 2018-05-02 06:33:12,956 INFO [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:12,959 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/12890.seqid, newMaxSeqId=12890, maxSeqId=12889 2018-05-02 06:33:12,962 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:33:12,962 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:33:12,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:12,963 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,963 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,966 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 5bd8c2cd29520d0d27cacb48e7436a6d; next sequenceid=12890 2018-05-02 06:33:12,969 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:33:12,969 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:33:12,969 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,970 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,971 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened c078deb2474e9c19b85b5fdb9efaa47d; next sequenceid=11368 2018-05-02 06:33:12,972 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:12,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 9f9b6704233f2d2e06a5634fda7f94ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:33:12,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AuthenticationService 2018-05-02 06:33:12,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=SecureBulkLoadService 2018-05-02 06:33:12,973 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,973 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,973 DEBUG [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:12,973 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:33:12,973 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:33:12,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 7386aea828f5bbf6f2bb9358162092e6, NAME => 'test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:33:12,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AuthenticationService 2018-05-02 06:33:12,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=SecureBulkLoadService 2018-05-02 06:33:12,974 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,974 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,974 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AccessControlService 2018-05-02 06:33:12,974 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:33:12,974 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:12,975 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,975 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 3b0ff50ae790418c1d7b36d704a3c7a8; next sequenceid=420 2018-05-02 06:33:12,979 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=34 2018-05-02 06:33:12,979 INFO [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:12,981 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:33:12,981 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:33:12,981 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:12,982 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:12,982 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1/3717a65158e54236b948e9f7a20e1344 2018-05-02 06:33:12,983 DEBUG [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:12,983 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:12,986 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:12,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:33:12,991 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 06:33:12,991 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:12,991 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 06:33:12,991 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:12,991 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:12,991 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:12,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 06:33:12,992 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,992 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:33:12,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:12,992 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:12,992 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,994 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AccessControlService 2018-05-02 06:33:12,996 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:12,997 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:12,997 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:33:12,997 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:12,998 INFO [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:12,999 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:12,999 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened b89f4262e34dfdd1fbea3661f9d50263; next sequenceid=35 2018-05-02 06:33:13,001 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:13,001 DEBUG [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:13,001 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,002 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:33:13,002 INFO [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:13,003 INFO [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:13,004 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 06:33:13,004 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 06:33:13,006 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,006 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,007 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12857.seqid, newMaxSeqId=12857, maxSeqId=12856 2018-05-02 06:33:13,010 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=426 2018-05-02 06:33:13,012 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12901.seqid, newMaxSeqId=12901, maxSeqId=12900 2018-05-02 06:33:13,013 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened e75a388bc2011feed75bdc1a0e99a9a9; next sequenceid=12857 2018-05-02 06:33:13,014 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/75.seqid, newMaxSeqId=75, maxSeqId=74 2018-05-02 06:33:13,016 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 06:33:13,016 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,016 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 06:33:13,016 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,018 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,018 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,018 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 06:33:13,019 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,019 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 06:33:13,019 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:13,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:13,019 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,021 DEBUG [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:13,021 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,021 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:33:13,022 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 06:33:13,022 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,022 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 06:33:13,022 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,022 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,022 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,022 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 06:33:13,023 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,023 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,023 DEBUG [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Finished post open deploy task for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:13,023 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:33:13,023 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:13,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,023 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,024 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:13,024 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,024 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:33:13,025 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 06:33:13,025 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,025 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 06:33:13,025 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,025 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,025 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,027 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 06:33:13,027 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,027 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,027 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:33:13,028 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:13,028 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f/44685d33ae944737b0ce1882809b4eb3 2018-05-02 06:33:13,028 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,028 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,030 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 3f187e06c01ee258024c3bcea437345b; next sequenceid=414 2018-05-02 06:33:13,030 INFO [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:13,032 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:33:13,032 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12819.seqid, newMaxSeqId=12819, maxSeqId=12818 2018-05-02 06:33:13,033 INFO [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:13,038 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12819 2018-05-02 06:33:13,038 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=75 2018-05-02 06:33:13,039 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened a0620fc83de532a37f6a9bb8f99cc6c4; next sequenceid=12901 2018-05-02 06:33:13,040 DEBUG [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:13,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => 299c3061e2a10cee5be3bff86a2ec41a, NAME => 'test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:33:13,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AuthenticationService 2018-05-02 06:33:13,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=SecureBulkLoadService 2018-05-02 06:33:13,041 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,041 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AccessControlService 2018-05-02 06:33:13,042 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,042 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:33:13,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:13,042 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,044 DEBUG [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:13,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 98abf1ead3bf61c95cc4ffe5e6e5fe96, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:33:13,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AuthenticationService 2018-05-02 06:33:13,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=SecureBulkLoadService 2018-05-02 06:33:13,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AccessControlService 2018-05-02 06:33:13,046 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:33:13,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:13,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,048 INFO [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:13,052 DEBUG [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:13,052 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,053 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 3ca34b6bdc72922097d54ce260dbd903, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903.', STARTKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C', ENDKEY => '\xD0\xD7\x945\xE5\x0Dy&'} 2018-05-02 06:33:13,053 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AuthenticationService 2018-05-02 06:33:13,053 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,053 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=SecureBulkLoadService 2018-05-02 06:33:13,054 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,054 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,054 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,054 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AccessControlService 2018-05-02 06:33:13,054 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,054 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,054 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:13,054 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:33:13,054 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:13,055 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,056 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:13,058 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:13,058 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,058 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 25414d6e395eadb383c40973693beb12, NAME => 'test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:33:13,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AuthenticationService 2018-05-02 06:33:13,059 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=SecureBulkLoadService 2018-05-02 06:33:13,059 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,059 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,059 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AccessControlService 2018-05-02 06:33:13,060 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,060 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,060 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 25414d6e395eadb383c40973693beb12 2018-05-02 06:33:13,060 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:13,060 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,063 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:13,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => a47cc34ca47759b3fd7bcaa79faebd3d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:33:13,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AuthenticationService 2018-05-02 06:33:13,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=SecureBulkLoadService 2018-05-02 06:33:13,064 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,064 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AccessControlService 2018-05-02 06:33:13,064 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:33:13,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:13,065 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,071 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:33:13,071 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:33:13,072 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,072 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/43.seqid, newMaxSeqId=43, maxSeqId=42 2018-05-02 06:33:13,081 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:33:13,081 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:33:13,082 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,082 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,083 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:33:13,083 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:33:13,084 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,085 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,087 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:33:13,087 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:33:13,087 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for g: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,088 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=43 2018-05-02 06:33:13,103 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:13,107 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:13,107 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,110 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:13,304 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1/b7efbef765ea477fa322e685336bf3fd 2018-05-02 06:33:13,304 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,320 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 47c574242e461d8e7a12972718bc27ff; next sequenceid=426 2018-05-02 06:33:13,328 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:33:13,328 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:33:13,329 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,330 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,332 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 06:33:13,332 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,334 INFO [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:13,337 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:33:13,337 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:33:13,338 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,338 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,340 DEBUG [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:13,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:33:13,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 06:33:13,341 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 06:33:13,341 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,341 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,341 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 06:33:13,342 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,342 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:33:13,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:13,342 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,355 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:33:13,355 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:33:13,356 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 06:33:13,356 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,356 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,357 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,357 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:33:13,357 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:33:13,357 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,358 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,388 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:33:13,388 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:33:13,389 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,391 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,392 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:33:13,392 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:33:13,393 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,393 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:33:13,412 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:33:13,412 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:33:13,412 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:33:13,413 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,414 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,415 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1/738c9260ad314f638f9a79ce7621a39e 2018-05-02 06:33:13,415 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,428 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf/3e55aa0d1ef34928a8504c63d2ce31e2 2018-05-02 06:33:13,428 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,433 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/58da7717f6144f42a435d0770d1a1079 2018-05-02 06:33:13,443 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 06:33:13,443 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:33:13,461 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:33:13,461 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:33:13,463 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,466 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,474 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:33:13,478 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/987d25463d724745b9b1288d46bcbfd8 2018-05-02 06:33:13,478 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=g, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,482 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 06:33:13,489 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:33:13,489 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:33:13,490 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,490 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,505 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:33:13,510 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/60b42671ed6b409aaa6359fb0d738bd1 2018-05-02 06:33:13,524 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:13,527 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:33:13,528 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:33:13,528 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for h: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,529 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,534 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1/90df418002ae42479d76f78c99ff2a2a 2018-05-02 06:33:13,534 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 681566c13ee68fa7a27c4bd39d5a79e0; next sequenceid=420 2018-05-02 06:33:13,534 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,535 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1/3d0f7026a4ef4c89aa664ab8b925b29f 2018-05-02 06:33:13,535 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,537 INFO [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:13,539 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 06:33:13,539 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,543 DEBUG [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:13,543 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,543 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:13,543 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:33:13,544 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 06:33:13,544 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,544 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 06:33:13,544 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,544 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,544 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,545 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 06:33:13,545 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,546 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1/7914c5e37a8a4498ac542a00c9e38435 2018-05-02 06:33:13,546 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 06:33:13,547 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,547 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,550 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened d5e9f3919d5e95ad2d6e01e1e16fa8ad; next sequenceid=420 2018-05-02 06:33:13,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:33:13,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:13,551 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 06:33:13,551 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,551 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,551 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/845389644a5e479097fbc8df18727132 2018-05-02 06:33:13,551 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,552 INFO [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:13,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:33:13,555 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12443.seqid, newMaxSeqId=12443, maxSeqId=12442 2018-05-02 06:33:13,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:33:13,559 DEBUG [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:13,559 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,559 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/a3641d2c563f4968adf6f952315d6af8 2018-05-02 06:33:13,560 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,560 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => a97e624ee736c77fbc6ccefb3abbac31, NAME => 'test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31.', STARTKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A', ENDKEY => '\x0DyC^P\xD7\x944'} 2018-05-02 06:33:13,560 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1/fd27d9b977b54177a8fb19407a54184c 2018-05-02 06:33:13,560 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,560 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AuthenticationService 2018-05-02 06:33:13,561 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=SecureBulkLoadService 2018-05-02 06:33:13,561 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,561 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,561 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AccessControlService 2018-05-02 06:33:13,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:33:13,562 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,562 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:33:13,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:13,562 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:33:13,567 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 06:33:13,570 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:33:13,571 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,575 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/bc3bcfcc061c4f8983a05c3b21b4aba4 2018-05-02 06:33:13,577 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/1ea04ea101ef4b97b972fcf1e2c389dc 2018-05-02 06:33:13,580 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12443 2018-05-02 06:33:13,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 06:33:13,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12604.seqid, newMaxSeqId=12604, maxSeqId=12603 2018-05-02 06:33:13,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:33:13,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13238.seqid, newMaxSeqId=13238, maxSeqId=13237 2018-05-02 06:33:13,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13238 2018-05-02 06:33:13,595 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:13,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 411bd5dbc3845cf91c0d9f4649c84b86; next sequenceid=12604 2018-05-02 06:33:13,597 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:33:13,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:33:13,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:33:13,601 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:13,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => a58d4c86d2df306cc460a231fd5a1ac1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:33:13,602 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AuthenticationService 2018-05-02 06:33:13,602 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,602 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=SecureBulkLoadService 2018-05-02 06:33:13,602 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,602 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,602 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,602 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AccessControlService 2018-05-02 06:33:13,602 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,603 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:33:13,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:13,603 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,608 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h/533a2948760c480ba34565e6621f062e 2018-05-02 06:33:13,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:13,615 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=h, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,616 INFO [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:13,616 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/d841feb0096c401b9a78e0050ee83d68 2018-05-02 06:33:13,617 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:13,617 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,620 DEBUG [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:13,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opening region: {ENCODED => 89df5caac424c7424fede4183c6dce19, NAME => 'test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:33:13,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AuthenticationService 2018-05-02 06:33:13,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=SecureBulkLoadService 2018-05-02 06:33:13,621 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,621 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AccessControlService 2018-05-02 06:33:13,621 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 89df5caac424c7424fede4183c6dce19 2018-05-02 06:33:13,622 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:13,622 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,623 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:13,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 960276b77c021b3663429298ac0cccd7, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7.', STARTKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF', ENDKEY => ''} 2018-05-02 06:33:13,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=AuthenticationService 2018-05-02 06:33:13,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,625 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened bc0d9cf47453518915ae21d2cf637c18; next sequenceid=417 2018-05-02 06:33:13,626 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/c2e9664311c1425886ec633633fdcd6b 2018-05-02 06:33:13,626 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=SecureBulkLoadService 2018-05-02 06:33:13,626 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,626 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,626 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,627 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=AccessControlService 2018-05-02 06:33:13,627 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,627 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,627 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,627 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 960276b77c021b3663429298ac0cccd7 2018-05-02 06:33:13,627 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:13,627 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,628 INFO [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:13,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13482.seqid, newMaxSeqId=13482, maxSeqId=13481 2018-05-02 06:33:13,631 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:33:13,631 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:33:13,631 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:33:13,632 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:33:13,632 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,632 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,632 DEBUG [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:13,632 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,632 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,633 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 19c6e3a27177cc57e6cf72ac907048ed, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 06:33:13,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AuthenticationService 2018-05-02 06:33:13,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=SecureBulkLoadService 2018-05-02 06:33:13,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AccessControlService 2018-05-02 06:33:13,635 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:33:13,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:13,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,635 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:33:13,636 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:33:13,636 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,637 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:13,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:13,639 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:33:13,639 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:33:13,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12810.seqid, newMaxSeqId=12810, maxSeqId=12809 2018-05-02 06:33:13,640 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for i: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,640 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,642 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11480.seqid, newMaxSeqId=11480, maxSeqId=11479 2018-05-02 06:33:13,644 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13482 2018-05-02 06:33:13,647 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 3ca34b6bdc72922097d54ce260dbd903; next sequenceid=420 2018-05-02 06:33:13,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12 2018-05-02 06:33:13,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:13,650 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:13,653 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11480 2018-05-02 06:33:13,653 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12810 2018-05-02 06:33:13,654 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:13,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,654 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 98abf1ead3bf61c95cc4ffe5e6e5fe96; next sequenceid=414 2018-05-02 06:33:13,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => a1d694475a6981010a6489a33c4db464, NAME => 'test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:33:13,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AuthenticationService 2018-05-02 06:33:13,655 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=SecureBulkLoadService 2018-05-02 06:33:13,655 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,655 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,656 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AccessControlService 2018-05-02 06:33:13,656 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,656 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a1d694475a6981010a6489a33c4db464 2018-05-02 06:33:13,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:13,657 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,660 INFO [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:13,661 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:33:13,662 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:33:13,662 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:33:13,662 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:33:13,663 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 9f9b6704233f2d2e06a5634fda7f94ca; next sequenceid=420 2018-05-02 06:33:13,664 INFO [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:13,665 DEBUG [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:13,665 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,665 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:33:13,666 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 06:33:13,666 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,666 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 06:33:13,666 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,666 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,666 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,666 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 06:33:13,666 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,666 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,666 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 06:33:13,667 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:13,667 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:13,667 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,667 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:13,669 DEBUG [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:13,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 2e8da78a5421f95de8c75e0053e1d4a0, NAME => 'test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:33:13,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AuthenticationService 2018-05-02 06:33:13,670 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=SecureBulkLoadService 2018-05-02 06:33:13,670 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,670 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,670 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AccessControlService 2018-05-02 06:33:13,670 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,670 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:33:13,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:13,671 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,672 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:13,674 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:13,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:33:13,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => e56a9c7383092895c06ee33b9b84d892, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892.', STARTKEY => '\xA1\xAF(k\xCA\x1A\xF2p', ENDKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A'} 2018-05-02 06:33:13,675 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 06:33:13,675 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=AuthenticationService 2018-05-02 06:33:13,676 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 06:33:13,676 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,676 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,676 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,677 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 06:33:13,677 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,677 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,677 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:33:13,677 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:13,678 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:13,679 INFO [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:13,686 DEBUG [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:13,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => 51969dda9dfa8895c283f334f944e248, NAME => 'test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:33:13,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AuthenticationService 2018-05-02 06:33:13,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=SecureBulkLoadService 2018-05-02 06:33:13,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AccessControlService 2018-05-02 06:33:13,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51969dda9dfa8895c283f334f944e248 2018-05-02 06:33:13,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:13,689 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,697 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,697 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=SecureBulkLoadService 2018-05-02 06:33:13,698 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,698 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,698 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=AccessControlService 2018-05-02 06:33:13,698 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,698 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12729.seqid, newMaxSeqId=12729, maxSeqId=12728 2018-05-02 06:33:13,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e56a9c7383092895c06ee33b9b84d892 2018-05-02 06:33:13,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:13,699 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12169.seqid, newMaxSeqId=12169, maxSeqId=12168 2018-05-02 06:33:13,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 022c10bc256d7e8dc5d475d7ff8545ea; next sequenceid=420 2018-05-02 06:33:13,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:33:13,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:13,725 DEBUG [StoreOpener-960276b77c021b3663429298ac0cccd7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/f1 2018-05-02 06:33:13,725 DEBUG [StoreOpener-960276b77c021b3663429298ac0cccd7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/f1 2018-05-02 06:33:13,726 INFO [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:13,726 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,727 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=12729 2018-05-02 06:33:13,733 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:33:13,733 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:33:13,735 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,736 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened a47cc34ca47759b3fd7bcaa79faebd3d; next sequenceid=414 2018-05-02 06:33:13,739 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,739 DEBUG [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:13,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => e1d84fe7eb9adbf61fec50c75876bce8, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 06:33:13,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AuthenticationService 2018-05-02 06:33:13,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=SecureBulkLoadService 2018-05-02 06:33:13,740 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,740 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AccessControlService 2018-05-02 06:33:13,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:33:13,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:13,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12169 2018-05-02 06:33:13,750 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:33:13,750 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:33:13,754 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,755 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,766 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:13,776 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:13,794 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:13,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 32b24a1d0ec05868d69a34a41559e784, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:33:13,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=AuthenticationService 2018-05-02 06:33:13,795 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=SecureBulkLoadService 2018-05-02 06:33:13,795 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,796 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,796 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=AccessControlService 2018-05-02 06:33:13,796 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,796 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 32b24a1d0ec05868d69a34a41559e784 2018-05-02 06:33:13,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:13,797 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,799 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:13,803 INFO [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:13,803 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:13,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => 41c625158570994727f1c92a8606ca6c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:33:13,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AuthenticationService 2018-05-02 06:33:13,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=SecureBulkLoadService 2018-05-02 06:33:13,805 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,805 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AccessControlService 2018-05-02 06:33:13,805 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 41c625158570994727f1c92a8606ca6c 2018-05-02 06:33:13,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:13,806 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,811 DEBUG [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:13,811 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,811 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 40744bb706fe10eab3c8964d0c6b003e, NAME => 'test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:33:13,812 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AuthenticationService 2018-05-02 06:33:13,812 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,812 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=SecureBulkLoadService 2018-05-02 06:33:13,812 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,812 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,812 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,812 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AccessControlService 2018-05-02 06:33:13,813 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,813 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,813 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:33:13,813 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:13,813 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,827 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 7386aea828f5bbf6f2bb9358162092e6; next sequenceid=420 2018-05-02 06:33:13,830 INFO [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:13,831 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 06:33:13,831 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,839 DEBUG [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:13,839 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,840 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:33:13,840 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 06:33:13,840 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 06:33:13,841 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,841 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,841 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 06:33:13,841 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,841 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:33:13,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:13,842 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,854 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:33:13,854 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:33:13,854 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,854 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,858 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:33:13,858 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:33:13,858 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:33:13,858 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:33:13,859 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:33:13,859 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:33:13,859 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:33:13,859 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:33:13,861 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,861 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,861 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,862 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,862 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,863 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,863 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,864 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,866 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1 2018-05-02 06:33:13,866 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1 2018-05-02 06:33:13,867 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,867 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,875 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i/85d84799b3024ff6a31c00aeddf0ee17 2018-05-02 06:33:13,875 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=i, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7 2018-05-02 06:33:13,886 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/586a58cac1d944569e94cf4983feab67 2018-05-02 06:33:13,900 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:33:13,900 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:33:13,901 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,902 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,904 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:33:13,904 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:33:13,904 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,905 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,909 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:33:13,910 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:33:13,910 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,911 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,916 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1 2018-05-02 06:33:13,916 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1 2018-05-02 06:33:13,917 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,917 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,929 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1/01f9f6a5501f41208ca4e0b19e9e7c04 2018-05-02 06:33:13,930 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:33:13,941 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:33:13,941 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:33:13,942 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,943 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,945 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:33:13,945 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:33:13,946 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:13,947 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:13,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:13,958 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened 299c3061e2a10cee5be3bff86a2ec41a; next sequenceid=426 2018-05-02 06:33:13,962 INFO [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:13,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:13,971 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/4f8205bfef3349d1b86f968ec0fb4484 2018-05-02 06:33:13,972 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,980 DEBUG [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:13,981 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:13,981 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => b9be42c9bb7b350e67325f3e6a3a59fb, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:33:13,982 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=AuthenticationService 2018-05-02 06:33:13,982 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:13,982 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=SecureBulkLoadService 2018-05-02 06:33:13,982 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:13,982 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:13,982 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:13,982 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=AccessControlService 2018-05-02 06:33:13,983 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:13,983 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:13,983 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b9be42c9bb7b350e67325f3e6a3a59fb 2018-05-02 06:33:13,983 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:13,984 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:13,984 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 25414d6e395eadb383c40973693beb12; next sequenceid=426 2018-05-02 06:33:13,995 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=10 2018-05-02 06:33:13,997 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1/01824852ca574c54a2a33f4964ca59ec 2018-05-02 06:33:13,997 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:13,999 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/8e427e1bd0004b8fa56fee85c7cc2ff5 2018-05-02 06:33:13,999 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,000 INFO [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:14,003 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1/329e30ab65dc41c3a17097e18564f58b 2018-05-02 06:33:14,003 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,005 DEBUG [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:14,005 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,005 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => a3403d29839e289caca7a1e3c5cd71be, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:33:14,005 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AuthenticationService 2018-05-02 06:33:14,006 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,006 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=SecureBulkLoadService 2018-05-02 06:33:14,006 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,006 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,006 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,006 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AccessControlService 2018-05-02 06:33:14,006 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,006 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,006 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:33:14,007 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:14,007 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,017 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1/25e6dd3bb4da4a4da1bd529eeab4af61 2018-05-02 06:33:14,017 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,029 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784 2018-05-02 06:33:14,032 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/62e84ec5a089460ba8f74c367544ffaa 2018-05-02 06:33:14,034 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 06:33:14,035 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1/4a57c45b7e83443f9ac51c1f0ee9e848 2018-05-02 06:33:14,039 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 06:33:14,039 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,040 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 960276b77c021b3663429298ac0cccd7; next sequenceid=11 2018-05-02 06:33:14,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464 2018-05-02 06:33:14,044 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 2018-05-02 06:33:14,047 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/14e594e5be3b4b11ab73ecade93c1f88 2018-05-02 06:33:14,049 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:33:14,050 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:33:14,051 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:33:14,051 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,051 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for m: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,052 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,050 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,051 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,056 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:33:14,057 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c 2018-05-02 06:33:14,058 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:33:14,058 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:33:14,058 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,059 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,061 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1/cb0610e65b5444349a49772cf9289fa4 2018-05-02 06:33:14,061 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1/f16708f1c3ad4ecc9898112fc1b25f50 2018-05-02 06:33:14,063 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,063 INFO [PostOpenDeployTasks:960276b77c021b3663429298ac0cccd7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:14,063 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,067 DEBUG [PostOpenDeployTasks:960276b77c021b3663429298ac0cccd7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:14,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => 685781049fdcc89efe3561b69e4d3810, NAME => 'test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:33:14,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AuthenticationService 2018-05-02 06:33:14,068 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=SecureBulkLoadService 2018-05-02 06:33:14,068 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,068 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,068 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,069 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AccessControlService 2018-05-02 06:33:14,069 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,069 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,069 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 685781049fdcc89efe3561b69e4d3810 2018-05-02 06:33:14,070 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:14,071 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,086 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/7710e9b7b85f4d579e501a6dce5fd537 2018-05-02 06:33:14,086 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/ac824897155b4c70ba4abc8ffd2779e9 2018-05-02 06:33:14,089 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,089 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,091 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1 2018-05-02 06:33:14,091 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1 2018-05-02 06:33:14,092 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,093 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,094 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 06:33:14,094 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:33:14,094 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,096 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:33:14,098 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:33:14,099 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 06:33:14,099 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892 2018-05-02 06:33:14,100 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:33:14,112 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:33:14,113 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12087.seqid, newMaxSeqId=12087, maxSeqId=12086 2018-05-02 06:33:14,135 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/991129869afa49349c27a04e163824ba 2018-05-02 06:33:14,135 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,145 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248 2018-05-02 06:33:14,149 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12087 2018-05-02 06:33:14,151 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:33:14,153 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:33:14,153 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:33:14,155 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:14,160 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,161 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,162 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:14,162 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,162 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:33:14,163 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 06:33:14,163 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,163 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m/86b207dade28462496c6e41eb3fb7b1f 2018-05-02 06:33:14,163 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:14,163 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,164 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 06:33:14,164 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,164 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,164 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,164 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 06:33:14,164 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,164 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,164 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:33:14,165 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:14,165 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,169 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened a58d4c86d2df306cc460a231fd5a1ac1; next sequenceid=420 2018-05-02 06:33:14,170 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:14,170 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:14,170 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:33:14,170 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:33:14,172 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/1b1b3109d73b4cc99883318973d6daff 2018-05-02 06:33:14,172 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for s: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,172 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,180 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19 2018-05-02 06:33:14,188 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 32b24a1d0ec05868d69a34a41559e784; next sequenceid=414 2018-05-02 06:33:14,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:14,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:14,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened 41c625158570994727f1c92a8606ca6c; next sequenceid=417 2018-05-02 06:33:14,192 INFO [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:14,192 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened a1d694475a6981010a6489a33c4db464; next sequenceid=423 2018-05-02 06:33:14,195 DEBUG [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:14,195 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => bcf3e62f0ae8e672bee1318720d62930, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:33:14,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AuthenticationService 2018-05-02 06:33:14,196 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=SecureBulkLoadService 2018-05-02 06:33:14,196 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,196 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,196 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,197 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AccessControlService 2018-05-02 06:33:14,197 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,197 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,197 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:33:14,197 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:14,198 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,202 INFO [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:14,206 DEBUG [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:14,206 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => a6d67b9eb3447b55a82b542d202ddd20, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:33:14,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=AuthenticationService 2018-05-02 06:33:14,207 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=SecureBulkLoadService 2018-05-02 06:33:14,207 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,207 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,207 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=AccessControlService 2018-05-02 06:33:14,208 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,208 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,208 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a6d67b9eb3447b55a82b542d202ddd20 2018-05-02 06:33:14,208 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:14,208 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,285 INFO [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:14,288 DEBUG [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:14,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:33:14,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 06:33:14,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 06:33:14,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened a97e624ee736c77fbc6ccefb3abbac31; next sequenceid=423 2018-05-02 06:33:14,292 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,292 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 06:33:14,293 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,293 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,293 INFO [PostOpenDeployTasks:32b24a1d0ec05868d69a34a41559e784] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:14,293 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:33:14,293 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:14,293 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12771.seqid, newMaxSeqId=12771, maxSeqId=12770 2018-05-02 06:33:14,296 DEBUG [PostOpenDeployTasks:32b24a1d0ec05868d69a34a41559e784] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:14,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 3f499471b0415a38ad5efe046913cba2, NAME => 'test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:33:14,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AuthenticationService 2018-05-02 06:33:14,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=SecureBulkLoadService 2018-05-02 06:33:14,296 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,296 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,297 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AccessControlService 2018-05-02 06:33:14,297 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,297 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,298 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3f499471b0415a38ad5efe046913cba2 2018-05-02 06:33:14,298 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:14,298 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,299 INFO [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:14,302 DEBUG [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:14,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,303 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12557.seqid, newMaxSeqId=12557, maxSeqId=12556 2018-05-02 06:33:14,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => 54c783f1faee76bcce84aee6145e82d1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:33:14,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AuthenticationService 2018-05-02 06:33:14,306 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12771 2018-05-02 06:33:14,306 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=SecureBulkLoadService 2018-05-02 06:33:14,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,306 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AccessControlService 2018-05-02 06:33:14,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,306 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,307 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:33:14,307 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:14,307 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,307 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1/ec664e55bd53459b869c26a0f2088bcc 2018-05-02 06:33:14,307 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:14,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:14,309 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:14,310 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:33:14,310 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:33:14,311 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,312 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,313 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/e948a42d644f4854aaf007ff04010533 2018-05-02 06:33:14,317 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12557 2018-05-02 06:33:14,317 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:33:14,317 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:33:14,318 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,319 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened e56a9c7383092895c06ee33b9b84d892; next sequenceid=417 2018-05-02 06:33:14,320 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,321 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 19c6e3a27177cc57e6cf72ac907048ed; next sequenceid=417 2018-05-02 06:33:14,321 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:14,325 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 2e8da78a5421f95de8c75e0053e1d4a0; next sequenceid=423 2018-05-02 06:33:14,326 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:14,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => 93f2d602c0a0a654856fb16863c2ff38, NAME => 'test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:33:14,327 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AuthenticationService 2018-05-02 06:33:14,327 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,327 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=SecureBulkLoadService 2018-05-02 06:33:14,328 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,328 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,328 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,328 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AccessControlService 2018-05-02 06:33:14,328 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,328 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,328 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:33:14,329 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:14,329 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13013.seqid, newMaxSeqId=13013, maxSeqId=13012 2018-05-02 06:33:14,349 INFO [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:14,355 DEBUG [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:14,355 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,356 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 93aea36f9251cfe49e28f84a517e3630, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:33:14,356 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AuthenticationService 2018-05-02 06:33:14,356 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,357 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=SecureBulkLoadService 2018-05-02 06:33:14,357 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,357 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,357 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,357 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AccessControlService 2018-05-02 06:33:14,357 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,357 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,357 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:33:14,358 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:14,359 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,372 INFO [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:14,374 INFO [PostOpenDeployTasks:e56a9c7383092895c06ee33b9b84d892] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:14,376 DEBUG [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:14,376 DEBUG [PostOpenDeployTasks:e56a9c7383092895c06ee33b9b84d892] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:14,377 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,377 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => fa24e8d8fdd999d38faae5dbf847c334, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:33:14,380 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AuthenticationService 2018-05-02 06:33:14,380 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=SecureBulkLoadService 2018-05-02 06:33:14,381 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,381 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,382 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,382 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 7524beb6ac348dac037dbf298ba07495, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:33:14,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AuthenticationService 2018-05-02 06:33:14,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=SecureBulkLoadService 2018-05-02 06:33:14,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AccessControlService 2018-05-02 06:33:14,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 7524beb6ac348dac037dbf298ba07495 2018-05-02 06:33:14,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:14,385 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AccessControlService 2018-05-02 06:33:14,387 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,387 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:33:14,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:14,387 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,395 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:14,399 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:14,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => 47377dfacc235cc247254a0eb8fe4f44, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44.', STARTKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0', ENDKEY => 'r\x86\xBC\xA1\xAF(k\xBA'} 2018-05-02 06:33:14,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=AuthenticationService 2018-05-02 06:33:14,401 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=SecureBulkLoadService 2018-05-02 06:33:14,401 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,401 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,401 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:14,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=AccessControlService 2018-05-02 06:33:14,401 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,401 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 47377dfacc235cc247254a0eb8fe4f44 2018-05-02 06:33:14,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:14,402 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,404 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=13013 2018-05-02 06:33:14,406 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 40744bb706fe10eab3c8964d0c6b003e; next sequenceid=423 2018-05-02 06:33:14,408 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/ab9566a0b14843359aac2c9357d7f66b 2018-05-02 06:33:14,419 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:14,424 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:14,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 7d91c8087e31e21951799651a5262353, NAME => 'test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:33:14,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AuthenticationService 2018-05-02 06:33:14,425 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=SecureBulkLoadService 2018-05-02 06:33:14,425 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,425 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,425 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AccessControlService 2018-05-02 06:33:14,426 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,426 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7d91c8087e31e21951799651a5262353 2018-05-02 06:33:14,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:14,426 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:14,429 INFO [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:14,432 DEBUG [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:14,432 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => 93a15c4ca6299bea02a86ac40494d75a, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:33:14,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AuthenticationService 2018-05-02 06:33:14,433 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=SecureBulkLoadService 2018-05-02 06:33:14,433 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,433 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,433 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AccessControlService 2018-05-02 06:33:14,434 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,434 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,434 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:33:14,434 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:14,434 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,546 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:33:14,546 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:33:14,546 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,547 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,821 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/246ab8cb4abd4f17b71986dd12fa3c37 2018-05-02 06:33:14,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:14,835 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:33:14,835 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:33:14,841 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,842 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,843 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:33:14,843 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:33:14,846 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1 2018-05-02 06:33:14,846 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,846 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1 2018-05-02 06:33:14,847 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,847 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,848 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,848 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened e1d84fe7eb9adbf61fec50c75876bce8; next sequenceid=417 2018-05-02 06:33:14,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb 2018-05-02 06:33:14,857 INFO [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:14,859 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:33:14,863 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened 51969dda9dfa8895c283f334f944e248; next sequenceid=423 2018-05-02 06:33:14,864 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:14,865 DEBUG [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:14,867 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:33:14,867 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:33:14,868 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,868 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,869 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,869 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 298977e880ecf479f4c50be95a5e8eb5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:33:14,870 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AuthenticationService 2018-05-02 06:33:14,870 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:33:14,870 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:33:14,871 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:33:14,871 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:33:14,871 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,872 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:14,872 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=SecureBulkLoadService 2018-05-02 06:33:14,872 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:14,872 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:14,872 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:14,872 INFO [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:14,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AccessControlService 2018-05-02 06:33:14,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:14,873 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:14,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:33:14,874 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:14,875 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:14,876 DEBUG [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:14,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,879 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:33:14,879 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:33:14,880 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,881 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,885 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1 2018-05-02 06:33:14,885 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1 2018-05-02 06:33:14,886 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,886 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] regionserver.HRegion: Opened 89df5caac424c7424fede4183c6dce19; next sequenceid=426 2018-05-02 06:33:14,889 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,900 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:33:14,900 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:33:14,902 INFO [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:14,902 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,903 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,905 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:33:14,905 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:33:14,907 DEBUG [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:14,907 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:14,908 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,909 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,915 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,922 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 06:33:14,922 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,923 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,928 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/e6968dada3bb41138eae59b19cb69762 2018-05-02 06:33:14,928 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=s, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,930 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/df553232e0f34ff59749e1f4f7761033 2018-05-02 06:33:14,930 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,955 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:33:14,956 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:33:14,960 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1/a3522ed3bfda433db7a713973ceaf88b 2018-05-02 06:33:14,961 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,972 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:33:14,972 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:33:14,972 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for t: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,973 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,974 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 06:33:14,974 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353 2018-05-02 06:33:14,978 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:33:14,978 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:33:14,979 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=4, currentSize=182.52 KB, freeSize=204.62 MB, maxSize=204.80 MB, heapSize=182.52 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:14,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810 2018-05-02 06:33:14,979 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:14,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:14,980 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:14,981 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=t, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,983 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1/5c806a6a8d2b4ef982bb8ac97a2fe60d 2018-05-02 06:33:14,983 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,986 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1/abc0da0f84f64790a2c93880ca66ac5e 2018-05-02 06:33:14,986 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:14,997 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/821797aa04f34c5ba99842ed2104658a 2018-05-02 06:33:14,999 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened b9be42c9bb7b350e67325f3e6a3a59fb; next sequenceid=420 2018-05-02 06:33:15,001 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened a3403d29839e289caca7a1e3c5cd71be; next sequenceid=426 2018-05-02 06:33:15,002 INFO [PostOpenDeployTasks:b9be42c9bb7b350e67325f3e6a3a59fb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:15,002 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:33:15,005 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/335c9d0ca00f43be9b2be1bdaf09a958 2018-05-02 06:33:15,006 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1/da3881a0cb0542f0a0fdfe2ffd2e6aba 2018-05-02 06:33:15,006 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:15,009 DEBUG [PostOpenDeployTasks:b9be42c9bb7b350e67325f3e6a3a59fb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:15,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,011 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:33:15,013 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1/f817097956b04d90a34738b22c734e7a 2018-05-02 06:33:15,014 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:15,014 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1/1d1b806509a34e0c9777f7096fbc3f1c 2018-05-02 06:33:15,014 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:15,015 INFO [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:15,018 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655 2018-05-02 06:33:15,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20 2018-05-02 06:33:15,019 DEBUG [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:15,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,021 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2 2018-05-02 06:33:15,028 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:33:15,031 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1/abb993ca728f419faab17bf60d381de0 2018-05-02 06:33:15,032 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:15,032 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495 2018-05-02 06:33:15,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:33:15,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table atlas_janus descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0M)) instead. 2018-05-02 06:33:15,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44 2018-05-02 06:33:15,045 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/accb28f8bfa44c80a458ea61bfad3c0c 2018-05-02 06:33:15,045 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:15,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/14.seqid, newMaxSeqId=14, maxSeqId=13 2018-05-02 06:33:15,051 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1/5dd531f9eb2a49a68712ee9638f0247b 2018-05-02 06:33:15,051 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:15,052 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/8cbf0c74e0754545a377c74c6bcdb70f 2018-05-02 06:33:15,052 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened 93a15c4ca6299bea02a86ac40494d75a; next sequenceid=14 2018-05-02 06:33:15,053 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:15,053 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11539.seqid, newMaxSeqId=11539, maxSeqId=11538 2018-05-02 06:33:15,054 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/14.seqid, newMaxSeqId=14, maxSeqId=13 2018-05-02 06:33:15,057 INFO [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:15,057 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:33:15,059 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 7d91c8087e31e21951799651a5262353; next sequenceid=14 2018-05-02 06:33:15,061 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11539 2018-05-02 06:33:15,062 DEBUG [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:15,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:33:15,069 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:15,069 INFO [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:15,069 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:15,072 DEBUG [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:15,073 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,073 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:33:15,074 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:15,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened 685781049fdcc89efe3561b69e4d3810; next sequenceid=426 2018-05-02 06:33:15,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:15,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12549.seqid, newMaxSeqId=12549, maxSeqId=12548 2018-05-02 06:33:15,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:15,079 INFO [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:15,082 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 7524beb6ac348dac037dbf298ba07495; next sequenceid=417 2018-05-02 06:33:15,083 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,084 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12549 2018-05-02 06:33:15,084 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened bcf3e62f0ae8e672bee1318720d62930; next sequenceid=417 2018-05-02 06:33:15,087 INFO [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:15,088 INFO [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:15,089 DEBUG [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:15,091 DEBUG [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:15,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,095 DEBUG [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:15,095 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,099 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:15,102 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:15,102 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,104 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:15,104 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:15,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:33:15,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:15,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1626.seqid, newMaxSeqId=1626, maxSeqId=1625 2018-05-02 06:33:15,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:15,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:15,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:15,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:15,108 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened 54c783f1faee76bcce84aee6145e82d1; next sequenceid=420 2018-05-02 06:33:15,108 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened a6d67b9eb3447b55a82b542d202ddd20; next sequenceid=417 2018-05-02 06:33:15,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened 93f2d602c0a0a654856fb16863c2ff38; next sequenceid=426 2018-05-02 06:33:15,111 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 3f499471b0415a38ad5efe046913cba2; next sequenceid=426 2018-05-02 06:33:15,111 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened 47377dfacc235cc247254a0eb8fe4f44; next sequenceid=420 2018-05-02 06:33:15,111 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened fa24e8d8fdd999d38faae5dbf847c334; next sequenceid=414 2018-05-02 06:33:15,111 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 93aea36f9251cfe49e28f84a517e3630; next sequenceid=423 2018-05-02 06:33:15,111 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 5080f353428ccd74e13d5b5493533655; next sequenceid=1626 2018-05-02 06:33:15,113 INFO [PostOpenDeployTasks:a6d67b9eb3447b55a82b542d202ddd20] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:15,114 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 298977e880ecf479f4c50be95a5e8eb5; next sequenceid=420 2018-05-02 06:33:15,116 INFO [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:15,118 DEBUG [PostOpenDeployTasks:a6d67b9eb3447b55a82b542d202ddd20] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:15,118 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,122 INFO [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Post open deploy tasks for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:15,122 INFO [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:15,122 INFO [PostOpenDeployTasks:47377dfacc235cc247254a0eb8fe4f44] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:15,123 INFO [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:15,123 INFO [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:15,123 INFO [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:15,126 DEBUG [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:15,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,127 DEBUG [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:15,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,127 DEBUG [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:15,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,128 DEBUG [PostOpenDeployTasks:47377dfacc235cc247254a0eb8fe4f44] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:15,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,128 DEBUG [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Finished post open deploy task for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:15,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,129 DEBUG [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:15,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,129 DEBUG [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:15,130 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:15,134 INFO [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:15,138 DEBUG [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:15,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:16,674 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:33:16,677 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:33:16,680 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:33:17,218 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:33:17,557 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:33:17,561 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:33:17,671 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:33:17,671 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:33:17,671 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:33:17,679 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:33:17,682 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:33:17,682 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:33:19,593 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:33:19,593 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 06:33:19,663 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table Wed May 2 06:33:20 UTC 2018 Terminating regionserver 2018-05-02 06:33:20,783 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:33:20,783 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:33:20,783 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:33:20,783 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:33:20,783 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:33:20,783 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:33:20,784 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:33:20,784 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:33:20,784 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 06:33:20,784 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:33:20,784 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:33:20,784 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:20,784 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:33:20,784 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:33:20,784 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:33:20,784 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:33:20,784 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896' ***** 2018-05-02 06:33:20,784 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:33:20,784 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=24.062 seconds, events=19, succcessCount=19, totalEvents=19, totalSuccessCount=19 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=54.064 seconds, events=38, succcessCount=19, totalEvents=38, totalSuccessCount=19 2018-05-02 06:33:20,785 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,785 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:20,785 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:33:20,786 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,787 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:33:20,787 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:33:20,787 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:33:20,787 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:33:20,787 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 exiting 2018-05-02 06:33:20,801 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:33:20,806 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:33:20,806 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:33:20,806 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:33:20,811 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:33:20,812 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:33:20,812 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:33:20,812 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:33:20,812 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:33:20,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,815 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,815 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,815 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,816 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 041977f7087dd987f3bc1c3b0d191155, disabling compactions & flushes 2018-05-02 06:33:20,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b32f7e3b20e736fd1681093bef6b435d, disabling compactions & flushes 2018-05-02 06:33:20,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:33:20,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:33:20,816 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,817 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,817 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,817 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,818 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing a1d694475a6981010a6489a33c4db464, disabling compactions & flushes 2018-05-02 06:33:20,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:20,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,819 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,819 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,819 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,820 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,820 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,821 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,821 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,821 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,822 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,822 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,822 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,822 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,823 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,823 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,823 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,826 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,826 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,826 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,827 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,827 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,827 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,830 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,830 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,830 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,830 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,830 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,831 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,831 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,831 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,831 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,832 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,835 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,835 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,835 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,837 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,837 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,837 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,837 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,839 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,839 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,839 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,839 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,840 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,840 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,840 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,840 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,847 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,847 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,847 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,849 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,849 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,849 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,851 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,851 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,851 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,853 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,853 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:20,853 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:33:20,853 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x3f26caea to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:33:20,853 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:33:20,854 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:33:20,854 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:33:20,854 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:33:20,854 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,872 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 135 regions to close 2018-05-02 06:33:20,875 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:20,882 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:20,883 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 06:33:20,883 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:20,883 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 06:33:20,883 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,883 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,884 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:33:20,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:33:20,885 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,885 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 385c8f00672f754fa0d7448f5ac543fa, disabling compactions & flushes 2018-05-02 06:33:20,885 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:33:20,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,887 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:20,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:20,887 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 06:33:20,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:20,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,888 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,889 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=95.20 KB memstore heap size=139.52 KB 2018-05-02 06:33:20,892 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:33:20,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:33:20,892 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,897 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 25414d6e395eadb383c40973693beb12, disabling compactions & flushes 2018-05-02 06:33:20,897 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:20,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12559.seqid, newMaxSeqId=12559, maxSeqId=12557 2018-05-02 06:33:20,931 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:20,936 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,936 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,936 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,936 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:20,937 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:20,937 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,937 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 3ca34b6bdc72922097d54ce260dbd903, disabling compactions & flushes 2018-05-02 06:33:20,937 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:20,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,938 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:20,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:20,938 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b89f4262e34dfdd1fbea3661f9d50263, disabling compactions & flushes 2018-05-02 06:33:20,939 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:20,939 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:20,953 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,953 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,953 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,953 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:33:20,954 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:33:20,954 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,954 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing e75a388bc2011feed75bdc1a0e99a9a9, disabling compactions & flushes 2018-05-02 06:33:20,955 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:20,972 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/37.seqid, newMaxSeqId=37, maxSeqId=35 2018-05-02 06:33:20,976 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,977 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,977 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,978 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:20,978 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:20,979 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,980 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 1bf9126ca1d7eb9abb934165d5f25857, disabling compactions & flushes 2018-05-02 06:33:20,981 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:33:20,983 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:20,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:20,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:20,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:20,987 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:20,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:20,987 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:20,988 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing da9e02fc1fdd80392463141e6bc6cf96, disabling compactions & flushes 2018-05-02 06:33:20,988 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:33:21,015 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12859.seqid, newMaxSeqId=12859, maxSeqId=12857 2018-05-02 06:33:21,020 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,020 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,020 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,020 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:21,020 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:21,021 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,021 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 960276b77c021b3663429298ac0cccd7, disabling compactions & flushes 2018-05-02 06:33:21,021 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:21,033 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,035 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12762.seqid, newMaxSeqId=12762, maxSeqId=12760 2018-05-02 06:33:21,036 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=95.20 KB at sequenceid=2892 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/d45d8a90947747948c7ad2c68791e902 2018-05-02 06:33:21,036 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,037 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:33:21,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:33:21,037 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,038 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 28608f50f9f828e7d3ab571a72b0d5f3, disabling compactions & flushes 2018-05-02 06:33:21,038 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:33:21,041 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,041 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,041 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,041 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:33:21,041 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:33:21,041 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing a6d67b9eb3447b55a82b542d202ddd20, disabling compactions & flushes 2018-05-02 06:33:21,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:21,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=11 2018-05-02 06:33:21,046 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,046 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,046 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,047 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:21,047 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:21,047 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,050 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 843b3b66a19c1c2d494720e99edc9c52, disabling compactions & flushes 2018-05-02 06:33:21,050 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:33:21,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12036.seqid, newMaxSeqId=12036, maxSeqId=12034 2018-05-02 06:33:21,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,065 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,065 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,065 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,065 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:33:21,065 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:33:21,066 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,066 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 681566c13ee68fa7a27c4bd39d5a79e0, disabling compactions & flushes 2018-05-02 06:33:21,066 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:21,070 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,070 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,070 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,071 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:21,071 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:21,071 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,071 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing a3403d29839e289caca7a1e3c5cd71be, disabling compactions & flushes 2018-05-02 06:33:21,071 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:21,076 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/d45d8a90947747948c7ad2c68791e902 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902 2018-05-02 06:33:21,092 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902, entries=600, sequenceid=2892, filesize=103.5 K 2018-05-02 06:33:21,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,096 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,096 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,096 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,097 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:33:21,097 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:33:21,098 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,098 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 06:33:21,098 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:33:21,099 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Finished memstore flush; data size ~95.20 KB/97486, heap size ~139.73 KB/143080, currentsize=0 B/0 for 1588230740 in 210ms, sequenceid=2892, compaction requested=false 2018-05-02 06:33:21,101 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,102 DEBUG [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/8169341d68cd4062b78ea05353d96adb, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/05aaed4155904938b4506f41d91511af, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d94dbfd81b8f43fe9bc92ec544ae2409] to archive 2018-05-02 06:33:21,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,105 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:21,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:21,105 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 7524beb6ac348dac037dbf298ba07495, disabling compactions & flushes 2018-05-02 06:33:21,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:21,109 DEBUG [StoreCloserThread-hbase:meta,,1.1588230740-1] backup.HFileArchiver: Archiving compacted files. 2018-05-02 06:33:21,112 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:21,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,116 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:21,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:21,117 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 06:33:21,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:21,121 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12248.seqid, newMaxSeqId=12248, maxSeqId=12246 2018-05-02 06:33:21,125 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,125 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,125 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,125 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:33:21,125 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:33:21,126 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,126 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 93a15c4ca6299bea02a86ac40494d75a, disabling compactions & flushes 2018-05-02 06:33:21,126 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:21,133 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,136 DEBUG [StoreCloserThread-hbase:meta,,1.1588230740-1] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/8169341d68cd4062b78ea05353d96adb to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/8169341d68cd4062b78ea05353d96adb 2018-05-02 06:33:21,136 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,137 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,137 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,137 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:21,137 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:21,137 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing bae4cdead31e3a4da5b719f67722e3d8, disabling compactions & flushes 2018-05-02 06:33:21,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:21,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12445.seqid, newMaxSeqId=12445, maxSeqId=12443 2018-05-02 06:33:21,144 DEBUG [StoreCloserThread-hbase:meta,,1.1588230740-1] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/05aaed4155904938b4506f41d91511af to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/05aaed4155904938b4506f41d91511af 2018-05-02 06:33:21,144 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=14 2018-05-02 06:33:21,146 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,146 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,146 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,146 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:21,146 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:21,147 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,147 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 06:33:21,147 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:21,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,148 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:21,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:21,149 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing a0792481dc7d859b1b63b04bf9adad81, disabling compactions & flushes 2018-05-02 06:33:21,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:33:21,152 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12364.seqid, newMaxSeqId=12364, maxSeqId=12362 2018-05-02 06:33:21,155 DEBUG [StoreCloserThread-hbase:meta,,1.1588230740-1] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d94dbfd81b8f43fe9bc92ec544ae2409 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/d94dbfd81b8f43fe9bc92ec544ae2409 2018-05-02 06:33:21,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,164 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,164 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,164 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:21,164 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:21,165 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,165 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 06:33:21,165 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:21,170 ERROR [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: ***** ABORTING region server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896: Unrecoverable exception while closing region hbase:meta,,1.1588230740, still finishing close ***** java.io.IOException: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1619) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1448) at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:104) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.HRegionServer.reportFileArchivalForQuotas(HRegionServer.java:3688) at org.apache.hadoop.hbase.regionserver.HStore.reportArchivedFilesForQuota(HStore.java:2691) at org.apache.hadoop.hbase.regionserver.HStore.removeCompactedfiles(HStore.java:2622) at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:902) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1597) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1594) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 more 2018-05-02 06:33:21,171 ERROR [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: [org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor, org.apache.hadoop.hbase.security.token.TokenProvider, org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint, org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2018-05-02 06:33:21,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11968.seqid, newMaxSeqId=11968, maxSeqId=11966 2018-05-02 06:33:21,178 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13484.seqid, newMaxSeqId=13484, maxSeqId=13482 2018-05-02 06:33:21,180 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,180 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,181 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,181 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:33:21,181 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:33:21,181 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 51969dda9dfa8895c283f334f944e248, disabling compactions & flushes 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,182 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:21,182 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 06:33:21,182 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:21,185 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12551.seqid, newMaxSeqId=12551, maxSeqId=12549 2018-05-02 06:33:21,188 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,188 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,189 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,189 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:21,189 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:21,189 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,189 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 29fe0b7866912efc70bb3f2d7fd83059, disabling compactions & flushes 2018-05-02 06:33:21,189 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:21,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13015.seqid, newMaxSeqId=13015, maxSeqId=13013 2018-05-02 06:33:21,208 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:21,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12775.seqid, newMaxSeqId=12775, maxSeqId=12773 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,212 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:21,212 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:21,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:21,213 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,213 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing bcf3e62f0ae8e672bee1318720d62930, disabling compactions & flushes 2018-05-02 06:33:21,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:21,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing cb06832d0afac8a9bdbe1f92ad565ab6, disabling compactions & flushes 2018-05-02 06:33:21,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:33:21,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,214 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:21,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:21,214 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 51119cebc42546d1c9f2590eec5a49b3, disabling compactions & flushes 2018-05-02 06:33:21,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:33:21,216 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Dump of metrics as JSON on abort: { "beans" : [ { "name" : "java.lang:type=Memory", "modelerType" : "sun.management.MemoryImpl", "ObjectPendingFinalizationCount" : 0, "NonHeapMemoryUsage" : { "committed" : 125763584, "init" : 2555904, "max" : -1, "used" : 123483760 }, "Verbose" : true, "HeapMemoryUsage" : { "committed" : 2147483648, "init" : 2147483648, "max" : 2147483648, "used" : 122249064 }, "ObjectName" : "java.lang:type=Memory" } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType" : "RegionServer,sub=IPC", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000008.hwx.site", "queueSize" : 0, "numCallsInGeneralQueue" : 0, "numCallsInReplicationQueue" : 0, "numCallsInPriorityQueue" : 0, "numOpenConnections" : 3, "numActiveHandler" : 0, "numGeneralCallsDropped" : 0, "numLifoModeSwitches" : 0, "numCallsInWriteQueue" : 0, "numCallsInReadQueue" : 0, "numCallsInScanQueue" : 0, "numActiveWriteHandler" : 0, "numActiveReadHandler" : 0, "numActiveScanHandler" : 0, "receivedBytes" : 192996, "exceptions.RegionMovedException" : 0, "exceptions.multiResponseTooLarge" : 0, "authenticationSuccesses" : 4, "authorizationFailures" : 0, "TotalCallTime_num_ops" : 263, "TotalCallTime_min" : 0, "TotalCallTime_max" : 219, "TotalCallTime_mean" : 12, "TotalCallTime_25th_percentile" : 23, "TotalCallTime_median" : 46, "TotalCallTime_75th_percentile" : 70, "TotalCallTime_90th_percentile" : 84, "TotalCallTime_95th_percentile" : 88, "TotalCallTime_98th_percentile" : 91, "TotalCallTime_99th_percentile" : 154, "TotalCallTime_99.9th_percentile" : 219, "TotalCallTime_TimeRangeCount_0-1" : 248, "TotalCallTime_TimeRangeCount_30-100" : 2, "TotalCallTime_TimeRangeCount_100-300" : 5, "TotalCallTime_TimeRangeCount_600000-inf" : 8, "exceptions.RegionTooBusyException" : 0, "exceptions.FailedSanityCheckException" : 0, "ResponseSize_num_ops" : 263, "ResponseSize_min" : 2, "ResponseSize_max" : 799, "ResponseSize_mean" : 64, "ResponseSize_25th_percentile" : 5, "ResponseSize_median" : 9, "ResponseSize_75th_percentile" : 76, "ResponseSize_90th_percentile" : 81, "ResponseSize_95th_percentile" : 81, "ResponseSize_98th_percentile" : 688, "ResponseSize_99th_percentile" : 743, "ResponseSize_99.9th_percentile" : 793, "ResponseSize_SizeRangeCount_0-10" : 153, "ResponseSize_SizeRangeCount_10-100" : 90, "ResponseSize_SizeRangeCount_100-1000" : 12, "ResponseSize_SizeRangeCount_100000000-inf" : 8, "exceptions.UnknownScannerException" : 0, "exceptions.OutOfOrderScannerNextException" : 0, "exceptions" : 2, "ProcessCallTime_num_ops" : 263, "ProcessCallTime_min" : 0, "ProcessCallTime_max" : 219, "ProcessCallTime_mean" : 11, "ProcessCallTime_25th_percentile" : 23, "ProcessCallTime_median" : 46, "ProcessCallTime_75th_percentile" : 69, "ProcessCallTime_90th_percentile" : 82, "ProcessCallTime_95th_percentile" : 87, "ProcessCallTime_98th_percentile" : 91, "ProcessCallTime_99th_percentile" : 154, "ProcessCallTime_99.9th_percentile" : 219, "ProcessCallTime_TimeRangeCount_0-1" : 249, "ProcessCallTime_TimeRangeCount_30-100" : 1, "ProcessCallTime_TimeRangeCount_100-300" : 5, "ProcessCallTime_TimeRangeCount_600000-inf" : 8, "authenticationFallbacks" : 0, "exceptions.NotServingRegionException" : 2, "exceptions.callQueueTooBig" : 0, "authorizationSuccesses" : 4, "exceptions.ScannerResetException" : 0, "RequestSize_num_ops" : 263, "RequestSize_min" : 79, "RequestSize_max" : 2873, "RequestSize_mean" : 307, "RequestSize_25th_percentile" : 172, "RequestSize_median" : 266, "RequestSize_75th_percentile" : 360, "RequestSize_90th_percentile" : 416, "RequestSize_95th_percentile" : 435, "RequestSize_98th_percentile" : 446, "RequestSize_99th_percentile" : 814, "RequestSize_99.9th_percentile" : 2790, "RequestSize_SizeRangeCount_0-10" : 252, "RequestSize_SizeRangeCount_100-1000" : 1, "RequestSize_SizeRangeCount_1000-10000" : 2, "RequestSize_SizeRangeCount_100000000-inf" : 8, "sentBytes" : 38950, "QueueCallTime_num_ops" : 263, "QueueCallTime_min" : 0, "QueueCallTime_max" : 6, "QueueCallTime_mean" : 0, "QueueCallTime_25th_percentile" : 0, "QueueCallTime_median" : 0, "QueueCallTime_75th_percentile" : 0, "QueueCallTime_90th_percentile" : 1, "QueueCallTime_95th_percentile" : 1, "QueueCallTime_98th_percentile" : 3, "QueueCallTime_99th_percentile" : 5, "QueueCallTime_99.9th_percentile" : 6, "QueueCallTime_TimeRangeCount_0-1" : 245, "QueueCallTime_TimeRangeCount_1-3" : 5, "QueueCallTime_TimeRangeCount_3-10" : 5, "QueueCallTime_TimeRangeCount_600000-inf" : 8, "authenticationFailures" : 0 } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType" : "RegionServer,sub=Replication", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000008.hwx.site", "sink.appliedHFiles" : 0, "sink.appliedOps" : 0, "Sink.ageOfLastAppliedOp_num_ops" : 0, "Sink.ageOfLastAppliedOp_min" : 0, "Sink.ageOfLastAppliedOp_max" : 0, "Sink.ageOfLastAppliedOp_mean" : 0, "Sink.ageOfLastAppliedOp_25th_percentile" : 0, "Sink.ageOfLastAppliedOp_median" : 0, "Sink.ageOfLastAppliedOp_75th_percentile" : 0, "Sink.ageOfLastAppliedOp_90th_percentile" : 0, "Sink.ageOfLastAppliedOp_95th_percentile" : 0, "Sink.ageOfLastAppliedOp_98th_percentile" : 0, "Sink.ageOfLastAppliedOp_99th_percentile" : 0, "Sink.ageOfLastAppliedOp_99.9th_percentile" : 0, "sink.appliedBatches" : 0 } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType" : "RegionServer,sub=Server", "tag.zookeeperQuorum" : "ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181", "tag.serverName" : "ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896", "tag.clusterId" : "1b48ec3a-bf8b-4867-bad7-52eb7796791c", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000008.hwx.site", "regionCount" : 135, "storeCount" : 144, "hlogFileCount" : 2, "hlogFileSize" : 0, "storeFileCount" : 164, "memStoreSize" : 97486, "storeFileSize" : 1279934734, "maxStoreFileAge" : 5525588, "minStoreFileAge" : 4060, "avgStoreFileAge" : 2288811, "numReferenceFiles" : 0, "regionServerStartTime" : 1525242616896, "averageRegionSize" : 9481720, "totalRequestCount" : 265, "totalRowActionRequestCount" : 249, "readRequestCount" : 99, "filteredReadRequestCount" : 0, "writeRequestCount" : 150, "rpcGetRequestCount" : 91, "rpcScanRequestCount" : 12, "rpcMultiRequestCount" : 0, "rpcMutateRequestCount" : 150, "checkMutateFailedCount" : 0, "checkMutatePassedCount" : 0, "storeFileIndexSize" : 2202448, "staticIndexSize" : 951731, "staticBloomSize" : 2303920, "mutationsWithoutWALCount" : 0, "mutationsWithoutWALSize" : 0, "percentFilesLocal" : 53.25345993041992, "percentFilesLocalSecondaryRegions" : 0.0, "splitQueueLength" : 0, "compactionQueueLength" : 0, "smallCompactionQueueLength" : 0, "largeCompactionQueueLength" : 0, "flushQueueLength" : 0, "blockCacheFreeSize" : 214561472, "blockCacheCount" : 4, "blockCacheSize" : 186896, "blockCacheHitCount" : 99, "blockCacheHitCountPrimary" : 99, "blockCacheMissCount" : 99, "blockCacheMissCountPrimary" : 99, "blockCacheEvictionCount" : 0, "blockCacheEvictionCountPrimary" : 0, "blockCacheCountHitPercent" : 50.0, "blockCacheExpressHitPercent" : 91.66666666666666, "blockCacheFailedInsertionCount" : 0, "blockCacheDataMissCount" : 29, "blockCacheLeafIndexMissCount" : 0, "blockCacheBloomChunkMissCount" : 0, "blockCacheMetaMissCount" : 0, "blockCacheRootIndexMissCount" : 0, "blockCacheIntermediateIndexMissCount" : 0, "blockCacheFileInfoMissCount" : 0, "blockCacheGeneralBloomMetaMissCount" : 0, "blockCacheDeleteFamilyBloomMissCount" : 0, "blockCacheTrailerMissCount" : 0, "blockCacheDataHitCount" : 99, "blockCacheLeafIndexHitCount" : 0, "blockCacheBloomChunkHitCount" : 0, "blockCacheMetaHitCount" : 0, "blockCacheRootIndexHitCount" : 0, "blockCacheIntermediateIndexHitCount" : 0, "blockCacheFileInfoHitCount" : 0, "blockCacheGeneralBloomMetaHitCount" : 0, "blockCacheDeleteFamilyBloomHitCount" : 0, "blockCacheTrailerHitCount" : 0, "l1CacheHitCount" : 99, "l1CacheMissCount" : 99, "l1CacheHitRatio" : 0.5, "l1CacheMissRatio" : 0.5, "l2CacheHitCount" : 0, "l2CacheMissCount" : 0, "l2CacheHitRatio" : 0.0, "l2CacheMissRatio" : 0.0, "updatesBlockedTime" : 0, "flushedCellsCount" : 0, "compactedCellsCount" : 2412, "majorCompactedCellsCount" : 0, "flushedCellsSize" : 0, "compactedCellsSize" : 389649, "majorCompactedCellsSize" : 0, "cellsCountCompactedFromMob" : 0, "cellsCountCompactedToMob" : 0, "cellsSizeCompactedFromMob" : 0, "cellsSizeCompactedToMob" : 0, "mobFlushCount" : 0, "mobFlushedCellsCount" : 0, "mobFlushedCellsSize" : 0, "mobScanCellsCount" : 0, "mobScanCellsSize" : 0, "mobFileCacheCount" : 0, "mobFileCacheAccessCount" : 0, "mobFileCacheMissCount" : 0, "mobFileCacheEvictedCount" : 0, "mobFileCacheHitPercent" : 0.0, "hedgedReads" : 0, "hedgedReadWins" : 0, "blockedRequestCount" : 0, "MajorCompactionTime_num_ops" : 0, "MajorCompactionTime_min" : 0, "MajorCompactionTime_max" : 0, "MajorCompactionTime_mean" : 0, "MajorCompactionTime_25th_percentile" : 0, "MajorCompactionTime_median" : 0, "MajorCompactionTime_75th_percentile" : 0, "MajorCompactionTime_90th_percentile" : 0, "MajorCompactionTime_95th_percentile" : 0, "MajorCompactionTime_98th_percentile" : 0, "MajorCompactionTime_99th_percentile" : 0, "MajorCompactionTime_99.9th_percentile" : 0, "PauseTimeWithGc_num_ops" : 0, "PauseTimeWithGc_min" : 0, "PauseTimeWithGc_max" : 0, "PauseTimeWithGc_mean" : 0, "PauseTimeWithGc_25th_percentile" : 0, "PauseTimeWithGc_median" : 0, "PauseTimeWithGc_75th_percentile" : 0, "PauseTimeWithGc_90th_percentile" : 0, "PauseTimeWithGc_95th_percentile" : 0, "PauseTimeWithGc_98th_percentile" : 0, "PauseTimeWithGc_99th_percentile" : 0, "PauseTimeWithGc_99.9th_percentile" : 0, "compactedOutputBytes" : 409510, "pauseWarnThresholdExceeded" : 0, "ScanTime_num_ops" : 12, "ScanTime_min" : 0, "ScanTime_max" : 10, "ScanTime_mean" : 3, "ScanTime_25th_percentile" : 1, "ScanTime_median" : 2, "ScanTime_75th_percentile" : 6, "ScanTime_90th_percentile" : 8, "ScanTime_95th_percentile" : 10, "ScanTime_98th_percentile" : 10, "ScanTime_99th_percentile" : 10, "ScanTime_99.9th_percentile" : 10, "ScanTime_TimeRangeCount_0-1" : 6, "ScanTime_TimeRangeCount_1-3" : 1, "ScanTime_TimeRangeCount_3-10" : 5, "Increment_num_ops" : 0, "Increment_min" : 0, "Increment_max" : 0, "Increment_mean" : 0, "Increment_25th_percentile" : 0, "Increment_median" : 0, "Increment_75th_percentile" : 0, "Increment_90th_percentile" : 0, "Increment_95th_percentile" : 0, "Increment_98th_percentile" : 0, "Increment_99th_percentile" : 0, "Increment_99.9th_percentile" : 0, "Delete_num_ops" : 0, "Delete_min" : 0, "Delete_max" : 0, "Delete_mean" : 0, "Delete_25th_percentile" : 0, "Delete_median" : 0, "Delete_75th_percentile" : 0, "Delete_90th_percentile" : 0, "Delete_95th_percentile" : 0, "Delete_98th_percentile" : 0, "Delete_99th_percentile" : 0, "Delete_99.9th_percentile" : 0, "Put_num_ops" : 150, "Put_min" : 2, "Put_max" : 89, "Put_mean" : 11, "Put_25th_percentile" : 5, "Put_median" : 7, "Put_75th_percentile" : 11, "Put_90th_percentile" : 17, "Put_95th_percentile" : 34, "Put_98th_percentile" : 75, "Put_99th_percentile" : 88, "Put_99.9th_percentile" : 89, "Put_TimeRangeCount_1-3" : 8, "Put_TimeRangeCount_3-10" : 103, "Put_TimeRangeCount_10-30" : 29, "Put_TimeRangeCount_30-100" : 10, "DeleteBatch_num_ops" : 0, "DeleteBatch_min" : 0, "DeleteBatch_max" : 0, "DeleteBatch_mean" : 0, "DeleteBatch_25th_percentile" : 0, "DeleteBatch_median" : 0, "DeleteBatch_75th_percentile" : 0, "DeleteBatch_90th_percentile" : 0, "DeleteBatch_95th_percentile" : 0, "DeleteBatch_98th_percentile" : 0, "DeleteBatch_99th_percentile" : 0, "DeleteBatch_99.9th_percentile" : 0, "splitRequestCount" : 0, "FlushMemstoreSize_num_ops" : 0, "FlushMemstoreSize_min" : 0, "FlushMemstoreSize_max" : 0, "FlushMemstoreSize_mean" : 0, "FlushMemstoreSize_25th_percentile" : 0, "FlushMemstoreSize_median" : 0, "FlushMemstoreSize_75th_percentile" : 0, "FlushMemstoreSize_90th_percentile" : 0, "FlushMemstoreSize_95th_percentile" : 0, "FlushMemstoreSize_98th_percentile" : 0, "FlushMemstoreSize_99th_percentile" : 0, "FlushMemstoreSize_99.9th_percentile" : 0, "CompactionInputFileCount_num_ops" : 1, "CompactionInputFileCount_min" : 3, "CompactionInputFileCount_max" : 3, "CompactionInputFileCount_mean" : 3, "CompactionInputFileCount_25th_percentile" : 3, "CompactionInputFileCount_median" : 3, "CompactionInputFileCount_75th_percentile" : 3, "CompactionInputFileCount_90th_percentile" : 3, "CompactionInputFileCount_95th_percentile" : 3, "CompactionInputFileCount_98th_percentile" : 3, "CompactionInputFileCount_99th_percentile" : 3, "CompactionInputFileCount_99.9th_percentile" : 3, "PutBatch_num_ops" : 0, "PutBatch_min" : 0, "PutBatch_max" : 0, "PutBatch_mean" : 0, "PutBatch_25th_percentile" : 0, "PutBatch_median" : 0, "PutBatch_75th_percentile" : 0, "PutBatch_90th_percentile" : 0, "PutBatch_95th_percentile" : 0, "PutBatch_98th_percentile" : 0, "PutBatch_99th_percentile" : 0, "PutBatch_99.9th_percentile" : 0, "CompactionTime_num_ops" : 1, "CompactionTime_min" : 838, "CompactionTime_max" : 838, "CompactionTime_mean" : 838, "CompactionTime_25th_percentile" : 838, "CompactionTime_median" : 838, "CompactionTime_75th_percentile" : 838, "CompactionTime_90th_percentile" : 838, "CompactionTime_95th_percentile" : 838, "CompactionTime_98th_percentile" : 838, "CompactionTime_99th_percentile" : 838, "CompactionTime_99.9th_percentile" : 838, "CompactionTime_TimeRangeCount_100-300" : 1, "Get_num_ops" : 89, "Get_min" : 0, "Get_max" : 158, "Get_mean" : 6, "Get_25th_percentile" : 1, "Get_median" : 1, "Get_75th_percentile" : 1, "Get_90th_percentile" : 8, "Get_95th_percentile" : 10, "Get_98th_percentile" : 153, "Get_99th_percentile" : 158, "Get_99.9th_percentile" : 158, "Get_TimeRangeCount_0-1" : 68, "Get_TimeRangeCount_1-3" : 7, "Get_TimeRangeCount_3-10" : 10, "Get_TimeRangeCount_10-30" : 1, "Get_TimeRangeCount_30-100" : 1, "Get_TimeRangeCount_100-300" : 2, "MajorCompactionInputFileCount_num_ops" : 0, "MajorCompactionInputFileCount_min" : 0, "MajorCompactionInputFileCount_max" : 0, "MajorCompactionInputFileCount_mean" : 0, "MajorCompactionInputFileCount_25th_percentile" : 0, "MajorCompactionInputFileCount_median" : 0, "MajorCompactionInputFileCount_75th_percentile" : 0, "MajorCompactionInputFileCount_90th_percentile" : 0, "MajorCompactionInputFileCount_95th_percentile" : 0, "MajorCompactionInputFileCount_98th_percentile" : 0, "MajorCompactionInputFileCount_99th_percentile" : 0, "MajorCompactionInputFileCount_99.9th_percentile" : 0, "CheckAndPut_num_ops" : 0, "CheckAndPut_min" : 0, "CheckAndPut_max" : 0, "CheckAndPut_mean" : 0, "CheckAndPut_25th_percentile" : 0, "CheckAndPut_median" : 0, "CheckAndPut_75th_percentile" : 0, "CheckAndPut_90th_percentile" : 0, "CheckAndPut_95th_percentile" : 0, "CheckAndPut_98th_percentile" : 0, "CheckAndPut_99th_percentile" : 0, "CheckAndPut_99.9th_percentile" : 0, "SplitTime_num_ops" : 0, "SplitTime_min" : 0, "SplitTime_max" : 0, "SplitTime_mean" : 0, "SplitTime_25th_percentile" : 0, "SplitTime_median" : 0, "SplitTime_75th_percentile" : 0, "SplitTime_90th_percentile" : 0, "SplitTime_95th_percentile" : 0, "SplitTime_98th_percentile" : 0, "SplitTime_99th_percentile" : 0, "SplitTime_99.9th_percentile" : 0, "MajorCompactionOutputSize_num_ops" : 0, "MajorCompactionOutputSize_min" : 0, "MajorCompactionOutputSize_max" : 0, "MajorCompactionOutputSize_mean" : 0, "MajorCompactionOutputSize_25th_percentile" : 0, "MajorCompactionOutputSize_median" : 0, "MajorCompactionOutputSize_75th_percentile" : 0, "MajorCompactionOutputSize_90th_percentile" : 0, "MajorCompactionOutputSize_95th_percentile" : 0, "MajorCompactionOutputSize_98th_percentile" : 0, "MajorCompactionOutputSize_99th_percentile" : 0, "MajorCompactionOutputSize_99.9th_percentile" : 0, "majorCompactedInputBytes" : 0, "slowAppendCount" : 0, "flushedOutputBytes" : 0, "CompactionOutputFileCount_num_ops" : 1, "CompactionOutputFileCount_min" : 1, "CompactionOutputFileCount_max" : 1, "CompactionOutputFileCount_mean" : 1, "CompactionOutputFileCount_25th_percentile" : 1, "CompactionOutputFileCount_median" : 1, "CompactionOutputFileCount_75th_percentile" : 1, "CompactionOutputFileCount_90th_percentile" : 1, "CompactionOutputFileCount_95th_percentile" : 1, "CompactionOutputFileCount_98th_percentile" : 1, "CompactionOutputFileCount_99th_percentile" : 1, "CompactionOutputFileCount_99.9th_percentile" : 1, "slowDeleteCount" : 0, "Replay_num_ops" : 0, "Replay_min" : 0, "Replay_max" : 0, "Replay_mean" : 0, "Replay_25th_percentile" : 0, "Replay_median" : 0, "Replay_75th_percentile" : 0, "Replay_90th_percentile" : 0, "Replay_95th_percentile" : 0, "Replay_98th_percentile" : 0, "Replay_99th_percentile" : 0, "Replay_99.9th_percentile" : 0, "FlushTime_num_ops" : 0, "FlushTime_min" : 0, "FlushTime_max" : 0, "FlushTime_mean" : 0, "FlushTime_25th_percentile" : 0, "FlushTime_median" : 0, "FlushTime_75th_percentile" : 0, "FlushTime_90th_percentile" : 0, "FlushTime_95th_percentile" : 0, "FlushTime_98th_percentile" : 0, "FlushTime_99th_percentile" : 0, "FlushTime_99.9th_percentile" : 0, "MajorCompactionInputSize_num_ops" : 0, "MajorCompactionInputSize_min" : 0, "MajorCompactionInputSize_max" : 0, "MajorCompactionInputSize_mean" : 0, "MajorCompactionInputSize_25th_percentile" : 0, "MajorCompactionInputSize_median" : 0, "MajorCompactionInputSize_75th_percentile" : 0, "MajorCompactionInputSize_90th_percentile" : 0, "MajorCompactionInputSize_95th_percentile" : 0, "MajorCompactionInputSize_98th_percentile" : 0, "MajorCompactionInputSize_99th_percentile" : 0, "MajorCompactionInputSize_99.9th_percentile" : 0, "pauseInfoThresholdExceeded" : 0, "splitSuccessCount" : 0, "CheckAndDelete_num_ops" : 0, "CheckAndDelete_min" : 0, "CheckAndDelete_max" : 0, "CheckAndDelete_mean" : 0, "CheckAndDelete_25th_percentile" : 0, "CheckAndDelete_median" : 0, "CheckAndDelete_75th_percentile" : 0, "CheckAndDelete_90th_percentile" : 0, "CheckAndDelete_95th_percentile" : 0, "CheckAndDelete_98th_percentile" : 0, "CheckAndDelete_99th_percentile" : 0, "CheckAndDelete_99.9th_percentile" : 0, "CompactionInputSize_num_ops" : 1, "CompactionInputSize_min" : 762980, "CompactionInputSize_max" : 762980, "CompactionInputSize_mean" : 762980, "CompactionInputSize_25th_percentile" : 762980, "CompactionInputSize_median" : 762980, "CompactionInputSize_75th_percentile" : 762980, "CompactionInputSize_90th_percentile" : 762980, "CompactionInputSize_95th_percentile" : 762980, "CompactionInputSize_98th_percentile" : 762980, "CompactionInputSize_99th_percentile" : 762980, "CompactionInputSize_99.9th_percentile" : 762980, "CompactionInputSize_SizeRangeCount_100-1000" : 1, "MajorCompactionOutputFileCount_num_ops" : 0, "MajorCompactionOutputFileCount_min" : 0, "MajorCompactionOutputFileCount_max" : 0, "MajorCompactionOutputFileCount_mean" : 0, "MajorCompactionOutputFileCount_25th_percentile" : 0, "MajorCompactionOutputFileCount_median" : 0, "MajorCompactionOutputFileCount_75th_percentile" : 0, "MajorCompactionOutputFileCount_90th_percentile" : 0, "MajorCompactionOutputFileCount_95th_percentile" : 0, "MajorCompactionOutputFileCount_98th_percentile" : 0, "MajorCompactionOutputFileCount_99th_percentile" : 0, "MajorCompactionOutputFileCount_99.9th_percentile" : 0, "ScanSize_num_ops" : 12, "ScanSize_min" : 769, "ScanSize_max" : 772, "ScanSize_mean" : 771, "ScanSize_25th_percentile" : 769, "ScanSize_median" : 770, "ScanSize_75th_percentile" : 771, "ScanSize_90th_percentile" : 771, "ScanSize_95th_percentile" : 771, "ScanSize_98th_percentile" : 771, "ScanSize_99th_percentile" : 771, "ScanSize_99.9th_percentile" : 771, "ScanSize_SizeRangeCount_100-1000" : 12, "slowGetCount" : 0, "flushedMemstoreBytes" : 0, "CompactionOutputSize_num_ops" : 1, "CompactionOutputSize_min" : 409510, "CompactionOutputSize_max" : 409510, "CompactionOutputSize_mean" : 409510, "CompactionOutputSize_25th_percentile" : 409510, "CompactionOutputSize_median" : 409510, "CompactionOutputSize_75th_percentile" : 409510, "CompactionOutputSize_90th_percentile" : 409510, "CompactionOutputSize_95th_percentile" : 409510, "CompactionOutputSize_98th_percentile" : 409510, "CompactionOutputSize_99th_percentile" : 409510, "CompactionOutputSize_99.9th_percentile" : 409510, "CompactionOutputSize_SizeRangeCount_100-1000" : 1, "majorCompactedOutputBytes" : 0, "PauseTimeWithoutGc_num_ops" : 0, "PauseTimeWithoutGc_min" : 0, "PauseTimeWithoutGc_max" : 0, "PauseTimeWithoutGc_mean" : 0, "PauseTimeWithoutGc_25th_percentile" : 0, "PauseTimeWithoutGc_median" : 0, "PauseTimeWithoutGc_75th_percentile" : 0, "PauseTimeWithoutGc_90th_percentile" : 0, "PauseTimeWithoutGc_95th_percentile" : 0, "PauseTimeWithoutGc_98th_percentile" : 0, "PauseTimeWithoutGc_99th_percentile" : 0, "PauseTimeWithoutGc_99.9th_percentile" : 0, "slowPutCount" : 0, "slowIncrementCount" : 0, "compactedInputBytes" : 762980, "Append_num_ops" : 0, "Append_min" : 0, "Append_max" : 0, "Append_mean" : 0, "Append_25th_percentile" : 0, "Append_median" : 0, "Append_75th_percentile" : 0, "Append_90th_percentile" : 0, "Append_95th_percentile" : 0, "Append_98th_percentile" : 0, "Append_99th_percentile" : 0, "Append_99.9th_percentile" : 0, "FlushOutputSize_num_ops" : 0, "FlushOutputSize_min" : 0, "FlushOutputSize_max" : 0, "FlushOutputSize_mean" : 0, "FlushOutputSize_25th_percentile" : 0, "FlushOutputSize_median" : 0, "FlushOutputSize_75th_percentile" : 0, "FlushOutputSize_90th_percentile" : 0, "FlushOutputSize_95th_percentile" : 0, "FlushOutputSize_98th_percentile" : 0, "FlushOutputSize_99th_percentile" : 0, "FlushOutputSize_99.9th_percentile" : 0, "Bulkload_count" : 0, "Bulkload_mean_rate" : 0.0, "Bulkload_1min_rate" : 0.0, "Bulkload_5min_rate" : 0.0, "Bulkload_15min_rate" : 0.0, "Bulkload_num_ops" : 0, "Bulkload_min" : 0, "Bulkload_max" : 0, "Bulkload_mean" : 0, "Bulkload_25th_percentile" : 0, "Bulkload_median" : 0, "Bulkload_75th_percentile" : 0, "Bulkload_90th_percentile" : 0, "Bulkload_95th_percentile" : 0, "Bulkload_98th_percentile" : 0, "Bulkload_99th_percentile" : 0, "Bulkload_99.9th_percentile" : 0 } ] } 2018-05-02 06:33:21,234 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12899.seqid, newMaxSeqId=12899, maxSeqId=12897 2018-05-02 06:33:21,238 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,238 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,238 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,238 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:21,238 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:21,239 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,239 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b7a376d86459306e108ed5a76373661f, disabling compactions & flushes 2018-05-02 06:33:21,239 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,240 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:33:21,240 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:33:21,240 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:33:21,240 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,240 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 06:33:21,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 06:33:21,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:21,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:33:21,247 ERROR [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] executor.EventHandler: Caught throwable while processing event M_RS_CLOSE_META java.lang.RuntimeException: java.io.IOException: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:116) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1619) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1448) at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:104) ... 4 more Caused by: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.HRegionServer.reportFileArchivalForQuotas(HRegionServer.java:3688) at org.apache.hadoop.hbase.regionserver.HStore.reportArchivedFilesForQuota(HStore.java:2691) at org.apache.hadoop.hbase.regionserver.HStore.removeCompactedfiles(HStore.java:2622) at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:902) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1597) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1594) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 more 2018-05-02 06:33:21,248 ERROR [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: ***** ABORTING region server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896: Caught throwable while processing event M_RS_CLOSE_META ***** java.lang.RuntimeException: java.io.IOException: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:116) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1619) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1448) at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:104) ... 4 more Caused by: java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.HRegionServer.reportFileArchivalForQuotas(HRegionServer.java:3688) at org.apache.hadoop.hbase.regionserver.HStore.reportArchivedFilesForQuota(HStore.java:2691) at org.apache.hadoop.hbase.regionserver.HStore.removeCompactedfiles(HStore.java:2622) at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:902) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1597) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1594) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 more 2018-05-02 06:33:21,248 ERROR [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: [org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor, org.apache.hadoop.hbase.security.token.TokenProvider, org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint, org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2018-05-02 06:33:21,255 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegionServer: Dump of metrics as JSON on abort: { "beans" : [ { "name" : "java.lang:type=Memory", "modelerType" : "sun.management.MemoryImpl", "ObjectPendingFinalizationCount" : 0, "NonHeapMemoryUsage" : { "committed" : 126287872, "init" : 2555904, "max" : -1, "used" : 123913840 }, "Verbose" : true, "HeapMemoryUsage" : { "committed" : 2147483648, "init" : 2147483648, "max" : 2147483648, "used" : 129589096 }, "ObjectName" : "java.lang:type=Memory" } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType" : "RegionServer,sub=IPC", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000008.hwx.site", "queueSize" : 0, "numCallsInGeneralQueue" : 0, "numCallsInReplicationQueue" : 0, "numCallsInPriorityQueue" : 0, "numOpenConnections" : 3, "numActiveHandler" : 0, "numGeneralCallsDropped" : 0, "numLifoModeSwitches" : 0, "numCallsInWriteQueue" : 0, "numCallsInReadQueue" : 0, "numCallsInScanQueue" : 0, "numActiveWriteHandler" : 0, "numActiveReadHandler" : 0, "numActiveScanHandler" : 0, "receivedBytes" : 192996, "exceptions.RegionMovedException" : 0, "exceptions.multiResponseTooLarge" : 0, "authenticationSuccesses" : 4, "authorizationFailures" : 0, "TotalCallTime_num_ops" : 263, "TotalCallTime_min" : 0, "TotalCallTime_max" : 219, "TotalCallTime_mean" : 12, "TotalCallTime_25th_percentile" : 23, "TotalCallTime_median" : 46, "TotalCallTime_75th_percentile" : 70, "TotalCallTime_90th_percentile" : 84, "TotalCallTime_95th_percentile" : 88, "TotalCallTime_98th_percentile" : 91, "TotalCallTime_99th_percentile" : 154, "TotalCallTime_99.9th_percentile" : 219, "TotalCallTime_TimeRangeCount_0-1" : 248, "TotalCallTime_TimeRangeCount_30-100" : 2, "TotalCallTime_TimeRangeCount_100-300" : 5, "TotalCallTime_TimeRangeCount_600000-inf" : 8, "exceptions.RegionTooBusyException" : 0, "exceptions.FailedSanityCheckException" : 0, "ResponseSize_num_ops" : 263, "ResponseSize_min" : 2, "ResponseSize_max" : 799, "ResponseSize_mean" : 64, "ResponseSize_25th_percentile" : 5, "ResponseSize_median" : 9, "ResponseSize_75th_percentile" : 76, "ResponseSize_90th_percentile" : 81, "ResponseSize_95th_percentile" : 81, "ResponseSize_98th_percentile" : 688, "ResponseSize_99th_percentile" : 743, "ResponseSize_99.9th_percentile" : 793, "ResponseSize_SizeRangeCount_0-10" : 153, "ResponseSize_SizeRangeCount_10-100" : 90, "ResponseSize_SizeRangeCount_100-1000" : 12, "ResponseSize_SizeRangeCount_100000000-inf" : 8, "exceptions.UnknownScannerException" : 0, "exceptions.OutOfOrderScannerNextException" : 0, "exceptions" : 2, "ProcessCallTime_num_ops" : 263, "ProcessCallTime_min" : 0, "ProcessCallTime_max" : 219, "ProcessCallTime_mean" : 11, "ProcessCallTime_25th_percentile" : 23, "ProcessCallTime_median" : 46, "ProcessCallTime_75th_percentile" : 69, "ProcessCallTime_90th_percentile" : 82, "ProcessCallTime_95th_percentile" : 87, "ProcessCallTime_98th_percentile" : 91, "ProcessCallTime_99th_percentile" : 154, "ProcessCallTime_99.9th_percentile" : 219, "ProcessCallTime_TimeRangeCount_0-1" : 249, "ProcessCallTime_TimeRangeCount_30-100" : 1, "ProcessCallTime_TimeRangeCount_100-300" : 5, "ProcessCallTime_TimeRangeCount_600000-inf" : 8, "authenticationFallbacks" : 0, "exceptions.NotServingRegionException" : 2, "exceptions.callQueueTooBig" : 0, "authorizationSuccesses" : 4, "exceptions.ScannerResetException" : 0, "RequestSize_num_ops" : 263, "RequestSize_min" : 79, "RequestSize_max" : 2873, "RequestSize_mean" : 307, "RequestSize_25th_percentile" : 172, "RequestSize_median" : 266, "RequestSize_75th_percentile" : 360, "RequestSize_90th_percentile" : 416, "RequestSize_95th_percentile" : 435, "RequestSize_98th_percentile" : 446, "RequestSize_99th_percentile" : 814, "RequestSize_99.9th_percentile" : 2790, "RequestSize_SizeRangeCount_0-10" : 252, "RequestSize_SizeRangeCount_100-1000" : 1, "RequestSize_SizeRangeCount_1000-10000" : 2, "RequestSize_SizeRangeCount_100000000-inf" : 8, "sentBytes" : 38950, "QueueCallTime_num_ops" : 263, "QueueCallTime_min" : 0, "QueueCallTime_max" : 6, "QueueCallTime_mean" : 0, "QueueCallTime_25th_percentile" : 0, "QueueCallTime_median" : 0, "QueueCallTime_75th_percentile" : 0, "QueueCallTime_90th_percentile" : 1, "QueueCallTime_95th_percentile" : 1, "QueueCallTime_98th_percentile" : 3, "QueueCallTime_99th_percentile" : 5, "QueueCallTime_99.9th_percentile" : 6, "QueueCallTime_TimeRangeCount_0-1" : 245, "QueueCallTime_TimeRangeCount_1-3" : 5, "QueueCallTime_TimeRangeCount_3-10" : 5, "QueueCallTime_TimeRangeCount_600000-inf" : 8, "authenticationFailures" : 0 } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType" : "RegionServer,sub=Replication", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000008.hwx.site", "sink.appliedHFiles" : 0, "sink.appliedOps" : 0, "Sink.ageOfLastAppliedOp_num_ops" : 0, "Sink.ageOfLastAppliedOp_min" : 0, "Sink.ageOfLastAppliedOp_max" : 0, "Sink.ageOfLastAppliedOp_mean" : 0, "Sink.ageOfLastAppliedOp_25th_percentile" : 0, "Sink.ageOfLastAppliedOp_median" : 0, "Sink.ageOfLastAppliedOp_75th_percentile" : 0, "Sink.ageOfLastAppliedOp_90th_percentile" : 0, "Sink.ageOfLastAppliedOp_95th_percentile" : 0, "Sink.ageOfLastAppliedOp_98th_percentile" : 0, "Sink.ageOfLastAppliedOp_99th_percentile" : 0, "Sink.ageOfLastAppliedOp_99.9th_percentile" : 0, "sink.appliedBatches" : 0 } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType" : "RegionServer,sub=Server", "tag.zookeeperQuorum" : "ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181", "tag.serverName" : "ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896", "tag.clusterId" : "1b48ec3a-bf8b-4867-bad7-52eb7796791c", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000008.hwx.site", "regionCount" : 135, "storeCount" : 144, "hlogFileCount" : 2, "hlogFileSize" : 0, "storeFileCount" : 164, "memStoreSize" : 97486, "storeFileSize" : 1279934734, "maxStoreFileAge" : 5525588, "minStoreFileAge" : 4060, "avgStoreFileAge" : 2288811, "numReferenceFiles" : 0, "regionServerStartTime" : 1525242616896, "averageRegionSize" : 9481720, "totalRequestCount" : 265, "totalRowActionRequestCount" : 249, "readRequestCount" : 99, "filteredReadRequestCount" : 0, "writeRequestCount" : 150, "rpcGetRequestCount" : 91, "rpcScanRequestCount" : 12, "rpcMultiRequestCount" : 0, "rpcMutateRequestCount" : 150, "checkMutateFailedCount" : 0, "checkMutatePassedCount" : 0, "storeFileIndexSize" : 2202448, "staticIndexSize" : 951731, "staticBloomSize" : 2303920, "mutationsWithoutWALCount" : 0, "mutationsWithoutWALSize" : 0, "percentFilesLocal" : 53.25345993041992, "percentFilesLocalSecondaryRegions" : 0.0, "splitQueueLength" : 0, "compactionQueueLength" : 0, "smallCompactionQueueLength" : 0, "largeCompactionQueueLength" : 0, "flushQueueLength" : 0, "blockCacheFreeSize" : 214561472, "blockCacheCount" : 4, "blockCacheSize" : 186896, "blockCacheHitCount" : 99, "blockCacheHitCountPrimary" : 99, "blockCacheMissCount" : 99, "blockCacheMissCountPrimary" : 99, "blockCacheEvictionCount" : 0, "blockCacheEvictionCountPrimary" : 0, "blockCacheCountHitPercent" : 50.0, "blockCacheExpressHitPercent" : 91.66666666666666, "blockCacheFailedInsertionCount" : 0, "blockCacheDataMissCount" : 29, "blockCacheLeafIndexMissCount" : 0, "blockCacheBloomChunkMissCount" : 0, "blockCacheMetaMissCount" : 0, "blockCacheRootIndexMissCount" : 0, "blockCacheIntermediateIndexMissCount" : 0, "blockCacheFileInfoMissCount" : 0, "blockCacheGeneralBloomMetaMissCount" : 0, "blockCacheDeleteFamilyBloomMissCount" : 0, "blockCacheTrailerMissCount" : 0, "blockCacheDataHitCount" : 99, "blockCacheLeafIndexHitCount" : 0, "blockCacheBloomChunkHitCount" : 0, "blockCacheMetaHitCount" : 0, "blockCacheRootIndexHitCount" : 0, "blockCacheIntermediateIndexHitCount" : 0, "blockCacheFileInfoHitCount" : 0, "blockCacheGeneralBloomMetaHitCount" : 0, "blockCacheDeleteFamilyBloomHitCount" : 0, "blockCacheTrailerHitCount" : 0, "l1CacheHitCount" : 99, "l1CacheMissCount" : 99, "l1CacheHitRatio" : 0.5, "l1CacheMissRatio" : 0.5, "l2CacheHitCount" : 0, "l2CacheMissCount" : 0, "l2CacheHitRatio" : 0.0, "l2CacheMissRatio" : 0.0, "updatesBlockedTime" : 0, "flushedCellsCount" : 0, "compactedCellsCount" : 2412, "majorCompactedCellsCount" : 0, "flushedCellsSize" : 0, "compactedCellsSize" : 389649, "majorCompactedCellsSize" : 0, "cellsCountCompactedFromMob" : 0, "cellsCountCompactedToMob" : 0, "cellsSizeCompactedFromMob" : 0, "cellsSizeCompactedToMob" : 0, "mobFlushCount" : 0, "mobFlushedCellsCount" : 0, "mobFlushedCellsSize" : 0, "mobScanCellsCount" : 0, "mobScanCellsSize" : 0, "mobFileCacheCount" : 0, "mobFileCacheAccessCount" : 0, "mobFileCacheMissCount" : 0, "mobFileCacheEvictedCount" : 0, "mobFileCacheHitPercent" : 0.0, "hedgedReads" : 0, "hedgedReadWins" : 0, "blockedRequestCount" : 0, "MajorCompactionTime_num_ops" : 0, "MajorCompactionTime_min" : 0, "MajorCompactionTime_max" : 0, "MajorCompactionTime_mean" : 0, "MajorCompactionTime_25th_percentile" : 0, "MajorCompactionTime_median" : 0, "MajorCompactionTime_75th_percentile" : 0, "MajorCompactionTime_90th_percentile" : 0, "MajorCompactionTime_95th_percentile" : 0, "MajorCompactionTime_98th_percentile" : 0, "MajorCompactionTime_99th_percentile" : 0, "MajorCompactionTime_99.9th_percentile" : 0, "PauseTimeWithGc_num_ops" : 0, "PauseTimeWithGc_min" : 0, "PauseTimeWithGc_max" : 0, "PauseTimeWithGc_mean" : 0, "PauseTimeWithGc_25th_percentile" : 0, "PauseTimeWithGc_median" : 0, "PauseTimeWithGc_75th_percentile" : 0, "PauseTimeWithGc_90th_percentile" : 0, "PauseTimeWithGc_95th_percentile" : 0, "PauseTimeWithGc_98th_percentile" : 0, "PauseTimeWithGc_99th_percentile" : 0, "PauseTimeWithGc_99.9th_percentile" : 0, "compactedOutputBytes" : 409510, "pauseWarnThresholdExceeded" : 0, "ScanTime_num_ops" : 12, "ScanTime_min" : 0, "ScanTime_max" : 10, "ScanTime_mean" : 3, "ScanTime_25th_percentile" : 1, "ScanTime_median" : 2, "ScanTime_75th_percentile" : 6, "ScanTime_90th_percentile" : 8, "ScanTime_95th_percentile" : 10, "ScanTime_98th_percentile" : 10, "ScanTime_99th_percentile" : 10, "ScanTime_99.9th_percentile" : 10, "ScanTime_TimeRangeCount_0-1" : 6, "ScanTime_TimeRangeCount_1-3" : 1, "ScanTime_TimeRangeCount_3-10" : 5, "Increment_num_ops" : 0, "Increment_min" : 0, "Increment_max" : 0, "Increment_mean" : 0, "Increment_25th_percentile" : 0, "Increment_median" : 0, "Increment_75th_percentile" : 0, "Increment_90th_percentile" : 0, "Increment_95th_percentile" : 0, "Increment_98th_percentile" : 0, "Increment_99th_percentile" : 0, "Increment_99.9th_percentile" : 0, "Delete_num_ops" : 0, "Delete_min" : 0, "Delete_max" : 0, "Delete_mean" : 0, "Delete_25th_percentile" : 0, "Delete_median" : 0, "Delete_75th_percentile" : 0, "Delete_90th_percentile" : 0, "Delete_95th_percentile" : 0, "Delete_98th_percentile" : 0, "Delete_99th_percentile" : 0, "Delete_99.9th_percentile" : 0, "Put_num_ops" : 150, "Put_min" : 2, "Put_max" : 89, "Put_mean" : 11, "Put_25th_percentile" : 5, "Put_median" : 7, "Put_75th_percentile" : 11, "Put_90th_percentile" : 17, "Put_95th_percentile" : 34, "Put_98th_percentile" : 75, "Put_99th_percentile" : 88, "Put_99.9th_percentile" : 89, "Put_TimeRangeCount_1-3" : 8, "Put_TimeRangeCount_3-10" : 103, "Put_TimeRangeCount_10-30" : 29, "Put_TimeRangeCount_30-100" : 10, "DeleteBatch_num_ops" : 0, "DeleteBatch_min" : 0, "DeleteBatch_max" : 0, "DeleteBatch_mean" : 0, "DeleteBatch_25th_percentile" : 0, "DeleteBatch_median" : 0, "DeleteBatch_75th_percentile" : 0, "DeleteBatch_90th_percentile" : 0, "DeleteBatch_95th_percentile" : 0, "DeleteBatch_98th_percentile" : 0, "DeleteBatch_99th_percentile" : 0, "DeleteBatch_99.9th_percentile" : 0, "splitRequestCount" : 0, "FlushMemstoreSize_num_ops" : 0, "FlushMemstoreSize_min" : 0, "FlushMemstoreSize_max" : 0, "FlushMemstoreSize_mean" : 0, "FlushMemstoreSize_25th_percentile" : 0, "FlushMemstoreSize_median" : 0, "FlushMemstoreSize_75th_percentile" : 0, "FlushMemstoreSize_90th_percentile" : 0, "FlushMemstoreSize_95th_percentile" : 0, "FlushMemstoreSize_98th_percentile" : 0, "FlushMemstoreSize_99th_percentile" : 0, "FlushMemstoreSize_99.9th_percentile" : 0, "CompactionInputFileCount_num_ops" : 1, "CompactionInputFileCount_min" : 3, "CompactionInputFileCount_max" : 3, "CompactionInputFileCount_mean" : 3, "CompactionInputFileCount_25th_percentile" : 3, "CompactionInputFileCount_median" : 3, "CompactionInputFileCount_75th_percentile" : 3, "CompactionInputFileCount_90th_percentile" : 3, "CompactionInputFileCount_95th_percentile" : 3, "CompactionInputFileCount_98th_percentile" : 3, "CompactionInputFileCount_99th_percentile" : 3, "CompactionInputFileCount_99.9th_percentile" : 3, "PutBatch_num_ops" : 0, "PutBatch_min" : 0, "PutBatch_max" : 0, "PutBatch_mean" : 0, "PutBatch_25th_percentile" : 0, "PutBatch_median" : 0, "PutBatch_75th_percentile" : 0, "PutBatch_90th_percentile" : 0, "PutBatch_95th_percentile" : 0, "PutBatch_98th_percentile" : 0, "PutBatch_99th_percentile" : 0, "PutBatch_99.9th_percentile" : 0, "CompactionTime_num_ops" : 1, "CompactionTime_min" : 838, "CompactionTime_max" : 838, "CompactionTime_mean" : 838, "CompactionTime_25th_percentile" : 838, "CompactionTime_median" : 838, "CompactionTime_75th_percentile" : 838, "CompactionTime_90th_percentile" : 838, "CompactionTime_95th_percentile" : 838, "CompactionTime_98th_percentile" : 838, "CompactionTime_99th_percentile" : 838, "CompactionTime_99.9th_percentile" : 838, "CompactionTime_TimeRangeCount_100-300" : 1, "Get_num_ops" : 89, "Get_min" : 0, "Get_max" : 158, "Get_mean" : 6, "Get_25th_percentile" : 1, "Get_median" : 1, "Get_75th_percentile" : 1, "Get_90th_percentile" : 8, "Get_95th_percentile" : 10, "Get_98th_percentile" : 153, "Get_99th_percentile" : 158, "Get_99.9th_percentile" : 158, "Get_TimeRangeCount_0-1" : 68, "Get_TimeRangeCount_1-3" : 7, "Get_TimeRangeCount_3-10" : 10, "Get_TimeRangeCount_10-30" : 1, "Get_TimeRangeCount_30-100" : 1, "Get_TimeRangeCount_100-300" : 2, "MajorCompactionInputFileCount_num_ops" : 0, "MajorCompactionInputFileCount_min" : 0, "MajorCompactionInputFileCount_max" : 0, "MajorCompactionInputFileCount_mean" : 0, "MajorCompactionInputFileCount_25th_percentile" : 0, "MajorCompactionInputFileCount_median" : 0, "MajorCompactionInputFileCount_75th_percentile" : 0, "MajorCompactionInputFileCount_90th_percentile" : 0, "MajorCompactionInputFileCount_95th_percentile" : 0, "MajorCompactionInputFileCount_98th_percentile" : 0, "MajorCompactionInputFileCount_99th_percentile" : 0, "MajorCompactionInputFileCount_99.9th_percentile" : 0, "CheckAndPut_num_ops" : 0, "CheckAndPut_min" : 0, "CheckAndPut_max" : 0, "CheckAndPut_mean" : 0, "CheckAndPut_25th_percentile" : 0, "CheckAndPut_median" : 0, "CheckAndPut_75th_percentile" : 0, "CheckAndPut_90th_percentile" : 0, "CheckAndPut_95th_percentile" : 0, "CheckAndPut_98th_percentile" : 0, "CheckAndPut_99th_percentile" : 0, "CheckAndPut_99.9th_percentile" : 0, "SplitTime_num_ops" : 0, "SplitTime_min" : 0, "SplitTime_max" : 0, "SplitTime_mean" : 0, "SplitTime_25th_percentile" : 0, "SplitTime_median" : 0, "SplitTime_75th_percentile" : 0, "SplitTime_90th_percentile" : 0, "SplitTime_95th_percentile" : 0, "SplitTime_98th_percentile" : 0, "SplitTime_99th_percentile" : 0, "SplitTime_99.9th_percentile" : 0, "MajorCompactionOutputSize_num_ops" : 0, "MajorCompactionOutputSize_min" : 0, "MajorCompactionOutputSize_max" : 0, "MajorCompactionOutputSize_mean" : 0, "MajorCompactionOutputSize_25th_percentile" : 0, "MajorCompactionOutputSize_median" : 0, "MajorCompactionOutputSize_75th_percentile" : 0, "MajorCompactionOutputSize_90th_percentile" : 0, "MajorCompactionOutputSize_95th_percentile" : 0, "MajorCompactionOutputSize_98th_percentile" : 0, "MajorCompactionOutputSize_99th_percentile" : 0, "MajorCompactionOutputSize_99.9th_percentile" : 0, "majorCompactedInputBytes" : 0, "slowAppendCount" : 0, "flushedOutputBytes" : 0, "CompactionOutputFileCount_num_ops" : 1, "CompactionOutputFileCount_min" : 1, "CompactionOutputFileCount_max" : 1, "CompactionOutputFileCount_mean" : 1, "CompactionOutputFileCount_25th_percentile" : 1, "CompactionOutputFileCount_median" : 1, "CompactionOutputFileCount_75th_percentile" : 1, "CompactionOutputFileCount_90th_percentile" : 1, "CompactionOutputFileCount_95th_percentile" : 1, "CompactionOutputFileCount_98th_percentile" : 1, "CompactionOutputFileCount_99th_percentile" : 1, "CompactionOutputFileCount_99.9th_percentile" : 1, "slowDeleteCount" : 0, "Replay_num_ops" : 0, "Replay_min" : 0, "Replay_max" : 0, "Replay_mean" : 0, "Replay_25th_percentile" : 0, "Replay_median" : 0, "Replay_75th_percentile" : 0, "Replay_90th_percentile" : 0, "Replay_95th_percentile" : 0, "Replay_98th_percentile" : 0, "Replay_99th_percentile" : 0, "Replay_99.9th_percentile" : 0, "FlushTime_num_ops" : 0, "FlushTime_min" : 0, "FlushTime_max" : 0, "FlushTime_mean" : 0, "FlushTime_25th_percentile" : 0, "FlushTime_median" : 0, "FlushTime_75th_percentile" : 0, "FlushTime_90th_percentile" : 0, "FlushTime_95th_percentile" : 0, "FlushTime_98th_percentile" : 0, "FlushTime_99th_percentile" : 0, "FlushTime_99.9th_percentile" : 0, "MajorCompactionInputSize_num_ops" : 0, "MajorCompactionInputSize_min" : 0, "MajorCompactionInputSize_max" : 0, "MajorCompactionInputSize_mean" : 0, "MajorCompactionInputSize_25th_percentile" : 0, "MajorCompactionInputSize_median" : 0, "MajorCompactionInputSize_75th_percentile" : 0, "MajorCompactionInputSize_90th_percentile" : 0, "MajorCompactionInputSize_95th_percentile" : 0, "MajorCompactionInputSize_98th_percentile" : 0, "MajorCompactionInputSize_99th_percentile" : 0, "MajorCompactionInputSize_99.9th_percentile" : 0, "pauseInfoThresholdExceeded" : 0, "splitSuccessCount" : 0, "CheckAndDelete_num_ops" : 0, "CheckAndDelete_min" : 0, "CheckAndDelete_max" : 0, "CheckAndDelete_mean" : 0, "CheckAndDelete_25th_percentile" : 0, "CheckAndDelete_median" : 0, "CheckAndDelete_75th_percentile" : 0, "CheckAndDelete_90th_percentile" : 0, "CheckAndDelete_95th_percentile" : 0, "CheckAndDelete_98th_percentile" : 0, "CheckAndDelete_99th_percentile" : 0, "CheckAndDelete_99.9th_percentile" : 0, "CompactionInputSize_num_ops" : 1, "CompactionInputSize_min" : 762980, "CompactionInputSize_max" : 762980, "CompactionInputSize_mean" : 762980, "CompactionInputSize_25th_percentile" : 762980, "CompactionInputSize_median" : 762980, "CompactionInputSize_75th_percentile" : 762980, "CompactionInputSize_90th_percentile" : 762980, "CompactionInputSize_95th_percentile" : 762980, "CompactionInputSize_98th_percentile" : 762980, "CompactionInputSize_99th_percentile" : 762980, "CompactionInputSize_99.9th_percentile" : 762980, "CompactionInputSize_SizeRangeCount_100-1000" : 1, "MajorCompactionOutputFileCount_num_ops" : 0, "MajorCompactionOutputFileCount_min" : 0, "MajorCompactionOutputFileCount_max" : 0, "MajorCompactionOutputFileCount_mean" : 0, "MajorCompactionOutputFileCount_25th_percentile" : 0, "MajorCompactionOutputFileCount_median" : 0, "MajorCompactionOutputFileCount_75th_percentile" : 0, "MajorCompactionOutputFileCount_90th_percentile" : 0, "MajorCompactionOutputFileCount_95th_percentile" : 0, "MajorCompactionOutputFileCount_98th_percentile" : 0, "MajorCompactionOutputFileCount_99th_percentile" : 0, "MajorCompactionOutputFileCount_99.9th_percentile" : 0, "ScanSize_num_ops" : 12, "ScanSize_min" : 769, "ScanSize_max" : 772, "ScanSize_mean" : 771, "ScanSize_25th_percentile" : 769, "ScanSize_median" : 770, "ScanSize_75th_percentile" : 771, "ScanSize_90th_percentile" : 771, "ScanSize_95th_percentile" : 771, "ScanSize_98th_percentile" : 771, "ScanSize_99th_percentile" : 771, "ScanSize_99.9th_percentile" : 771, "ScanSize_SizeRangeCount_100-1000" : 12, "slowGetCount" : 0, "flushedMemstoreBytes" : 0, "CompactionOutputSize_num_ops" : 1, "CompactionOutputSize_min" : 409510, "CompactionOutputSize_max" : 409510, "CompactionOutputSize_mean" : 409510, "CompactionOutputSize_25th_percentile" : 409510, "CompactionOutputSize_median" : 409510, "CompactionOutputSize_75th_percentile" : 409510, "CompactionOutputSize_90th_percentile" : 409510, "CompactionOutputSize_95th_percentile" : 409510, "CompactionOutputSize_98th_percentile" : 409510, "CompactionOutputSize_99th_percentile" : 409510, "CompactionOutputSize_99.9th_percentile" : 409510, "CompactionOutputSize_SizeRangeCount_100-1000" : 1, "majorCompactedOutputBytes" : 0, "PauseTimeWithoutGc_num_ops" : 0, "PauseTimeWithoutGc_min" : 0, "PauseTimeWithoutGc_max" : 0, "PauseTimeWithoutGc_mean" : 0, "PauseTimeWithoutGc_25th_percentile" : 0, "PauseTimeWithoutGc_median" : 0, "PauseTimeWithoutGc_75th_percentile" : 0, "PauseTimeWithoutGc_90th_percentile" : 0, "PauseTimeWithoutGc_95th_percentile" : 0, "PauseTimeWithoutGc_98th_percentile" : 0, "PauseTimeWithoutGc_99th_percentile" : 0, "PauseTimeWithoutGc_99.9th_percentile" : 0, "slowPutCount" : 0, "slowIncrementCount" : 0, "compactedInputBytes" : 762980, "Append_num_ops" : 0, "Append_min" : 0, "Append_max" : 0, "Append_mean" : 0, "Append_25th_percentile" : 0, "Append_median" : 0, "Append_75th_percentile" : 0, "Append_90th_percentile" : 0, "Append_95th_percentile" : 0, "Append_98th_percentile" : 0, "Append_99th_percentile" : 0, "Append_99.9th_percentile" : 0, "FlushOutputSize_num_ops" : 0, "FlushOutputSize_min" : 0, "FlushOutputSize_max" : 0, "FlushOutputSize_mean" : 0, "FlushOutputSize_25th_percentile" : 0, "FlushOutputSize_median" : 0, "FlushOutputSize_75th_percentile" : 0, "FlushOutputSize_90th_percentile" : 0, "FlushOutputSize_95th_percentile" : 0, "FlushOutputSize_98th_percentile" : 0, "FlushOutputSize_99th_percentile" : 0, "FlushOutputSize_99.9th_percentile" : 0, "Bulkload_count" : 0, "Bulkload_mean_rate" : 0.0, "Bulkload_1min_rate" : 0.0, "Bulkload_5min_rate" : 0.0, "Bulkload_15min_rate" : 0.0, "Bulkload_num_ops" : 0, "Bulkload_min" : 0, "Bulkload_max" : 0, "Bulkload_mean" : 0, "Bulkload_25th_percentile" : 0, "Bulkload_median" : 0, "Bulkload_75th_percentile" : 0, "Bulkload_90th_percentile" : 0, "Bulkload_95th_percentile" : 0, "Bulkload_98th_percentile" : 0, "Bulkload_99th_percentile" : 0, "Bulkload_99.9th_percentile" : 0 } ] } 2018-05-02 06:33:21,258 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,259 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12809.seqid, newMaxSeqId=12809, maxSeqId=12807 2018-05-02 06:33:21,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,263 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:33:21,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:33:21,263 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 06:33:21,264 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:21,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:33:21,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:21,264 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 93f2d602c0a0a654856fb16863c2ff38, disabling compactions & flushes 2018-05-02 06:33:21,265 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:21,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12311.seqid, newMaxSeqId=12311, maxSeqId=12309 2018-05-02 06:33:21,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,269 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:33:21,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:33:21,269 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 3ea52812fafc49b1651e26e1bd43ec97, disabling compactions & flushes 2018-05-02 06:33:21,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:33:21,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,276 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,276 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 06:33:21,276 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 06:33:21,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:21,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,287 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:21,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:21,287 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,288 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 47c574242e461d8e7a12972718bc27ff, disabling compactions & flushes 2018-05-02 06:33:21,288 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:21,288 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12255.seqid, newMaxSeqId=12255, maxSeqId=12253 2018-05-02 06:33:21,289 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,291 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:33:21,292 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:33:21,292 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,292 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing bc0d9cf47453518915ae21d2cf637c18, disabling compactions & flushes 2018-05-02 06:33:21,292 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:21,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,293 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:33:21,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:33:21,293 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,294 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 7386aea828f5bbf6f2bb9358162092e6, disabling compactions & flushes 2018-05-02 06:33:21,294 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:21,304 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/2895.seqid, newMaxSeqId=2895, maxSeqId=2739 2018-05-02 06:33:21,312 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,312 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:33:21,312 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,312 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,312 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 06:33:21,313 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 06:33:21,320 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:21,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:21,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,339 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:21,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:21,339 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,340 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 6cfc24cc3a423e0969138ce2a69be99e, disabling compactions & flushes 2018-05-02 06:33:21,340 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:33:21,343 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,343 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,343 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,343 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:21,343 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:21,343 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,343 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 9f9b6704233f2d2e06a5634fda7f94ca, disabling compactions & flushes 2018-05-02 06:33:21,343 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:21,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,354 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:21,355 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:21,355 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,355 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 3f499471b0415a38ad5efe046913cba2, disabling compactions & flushes 2018-05-02 06:33:21,355 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:21,373 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12256.seqid, newMaxSeqId=12256, maxSeqId=12254 2018-05-02 06:33:21,374 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:21,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,376 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:33:21,377 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:33:21,377 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,377 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 8cb8f1e8202d0fae01b5300bd7c59bcb, disabling compactions & flushes 2018-05-02 06:33:21,377 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,378 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:21,378 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:21,378 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 32b24a1d0ec05868d69a34a41559e784, disabling compactions & flushes 2018-05-02 06:33:21,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:21,378 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:21,380 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing f3ccd3e0671152671071dbba3e2cb560, disabling compactions & flushes 2018-05-02 06:33:21,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:33:21,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:21,426 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,427 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,427 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,427 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,428 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:21,428 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:21,428 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,429 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12805.seqid, newMaxSeqId=12805, maxSeqId=12803 2018-05-02 06:33:21,430 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 6e9424b67ac115dc3547de9b3eb4c5ef, disabling compactions & flushes 2018-05-02 06:33:21,430 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:33:21,431 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,431 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,431 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,431 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:33:21,431 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:33:21,431 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 685781049fdcc89efe3561b69e4d3810, disabling compactions & flushes 2018-05-02 06:33:21,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:21,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,434 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:33:21,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:33:21,435 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,435 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing b9be42c9bb7b350e67325f3e6a3a59fb, disabling compactions & flushes 2018-05-02 06:33:21,435 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:21,465 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,470 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:21,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,471 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:21,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:21,472 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 70ed82a86a0f0c62d692e8ffd1c0f904, disabling compactions & flushes 2018-05-02 06:33:21,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:33:21,474 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,474 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,474 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,474 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:21,474 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:21,474 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,475 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b52f5cecdefd18652f3e796b8dada29f, disabling compactions & flushes 2018-05-02 06:33:21,475 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:33:21,476 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,485 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:33:21,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:33:21,485 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 06:33:21,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:21,499 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:21,502 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,502 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,503 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,503 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:33:21,503 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:33:21,503 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 7d91c8087e31e21951799651a5262353, disabling compactions & flushes 2018-05-02 06:33:21,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:21,511 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:21,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,515 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:33:21,516 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:33:21,516 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,516 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 06:33:21,516 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:21,547 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=14 2018-05-02 06:33:21,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] ipc.RpcServer: callId: 1375 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:34096 deadline: 1525242891558, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] ipc.RpcServer: callId: 8835 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:59580 deadline: 1525242891558, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.Chore.1] hbase.ScheduledChore: Chore: MemstoreFlusherChore was stopped 2018-05-02 06:33:21,633 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.leaseChecker] regionserver.Leases: Closed leases 2018-05-02 06:33:21,665 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=8,queue=0,port=16020] ipc.RpcServer: callId: 1376 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:34096 deadline: 1525242891664, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,667 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=8,queue=0,port=16020] ipc.RpcServer: callId: 8836 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:59580 deadline: 1525242891667, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,770 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=8,queue=0,port=16020] ipc.RpcServer: callId: 1377 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:34096 deadline: 1525242891770, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,771 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=10,queue=0,port=16020] ipc.RpcServer: callId: 8837 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:59580 deadline: 1525242891771, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,878 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 83 regions to close 2018-05-02 06:33:21,947 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12171.seqid, newMaxSeqId=12171, maxSeqId=12169 2018-05-02 06:33:21,948 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,948 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,948 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,948 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:21,948 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:21,948 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,949 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 45aba4505046246827a28b03d1c2611e, disabling compactions & flushes 2018-05-02 06:33:21,949 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:33:21,951 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,951 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,951 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,952 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:21,952 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:21,952 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,952 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing f61045f3bb8866c33d9b05635d777d75, disabling compactions & flushes 2018-05-02 06:33:21,952 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:33:21,954 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11482.seqid, newMaxSeqId=11482, maxSeqId=11480 2018-05-02 06:33:21,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,959 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:21,960 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:21,960 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,960 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 83a4166017315b69b94bd868d994447b, disabling compactions & flushes 2018-05-02 06:33:21,960 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:33:21,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:21,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,969 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:33:21,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:33:21,970 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,970 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 54c783f1faee76bcce84aee6145e82d1, disabling compactions & flushes 2018-05-02 06:33:21,970 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:21,977 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=8,queue=0,port=16020] ipc.RpcServer: callId: 8838 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:59580 deadline: 1525242891976, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,978 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=10,queue=0,port=16020] ipc.RpcServer: callId: 1378 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:34096 deadline: 1525242891977, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:21,978 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:21,982 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:21,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,986 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:33:21,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:33:21,986 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b91e4798ff3d5547c13242b7b77e2f63, disabling compactions & flushes 2018-05-02 06:33:21,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:33:21,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:21,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:21,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:21,987 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:33:21,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:33:21,987 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:21,988 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 41c625158570994727f1c92a8606ca6c, disabling compactions & flushes 2018-05-02 06:33:21,988 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:21,998 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,004 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,005 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:22,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:22,005 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 40744bb706fe10eab3c8964d0c6b003e, disabling compactions & flushes 2018-05-02 06:33:22,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:22,019 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:22,020 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,028 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:22,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:22,028 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 06:33:22,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:22,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,029 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:33:22,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:33:22,029 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 299c3061e2a10cee5be3bff86a2ec41a, disabling compactions & flushes 2018-05-02 06:33:22,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:22,049 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:22,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,052 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:22,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:22,052 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,053 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 299ab8318d1b1d267135f988608683b7, disabling compactions & flushes 2018-05-02 06:33:22,053 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:33:22,055 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:22,057 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12821.seqid, newMaxSeqId=12821, maxSeqId=12819 2018-05-02 06:33:22,061 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,062 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:22,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,062 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:22,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:22,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:22,062 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,062 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b03e6835fbab67365568f0d2520e68de, disabling compactions & flushes 2018-05-02 06:33:22,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 2fd8c4d5abf9928da8e8c547a0ca223a, disabling compactions & flushes 2018-05-02 06:33:22,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:33:22,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:33:22,075 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12445.seqid, newMaxSeqId=12445, maxSeqId=12443 2018-05-02 06:33:22,079 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,079 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,080 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,080 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:33:22,080 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:33:22,080 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,080 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 06:33:22,080 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:33:22,097 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,100 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12332.seqid, newMaxSeqId=12332, maxSeqId=12330 2018-05-02 06:33:22,102 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,103 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,103 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,103 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:33:22,103 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:33:22,103 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,103 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 5de3546305c82231844eb840c6cfa983, disabling compactions & flushes 2018-05-02 06:33:22,104 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:33:22,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,107 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:33:22,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:33:22,108 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,108 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 9c4d77e622ed44a126e39f057f044750, disabling compactions & flushes 2018-05-02 06:33:22,108 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:33:22,109 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12467.seqid, newMaxSeqId=12467, maxSeqId=12465 2018-05-02 06:33:22,112 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,112 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,112 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,112 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:33:22,112 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:33:22,113 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a28a981dbde91491f904c000efc74ecb, disabling compactions & flushes 2018-05-02 06:33:22,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:22,130 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:22,130 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,132 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,137 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,137 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,138 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 166b9a4d8133a32343e23907c3228d62, disabling compactions & flushes 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:33:22,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing b8144dc37f351e256653e1454207538f, disabling compactions & flushes 2018-05-02 06:33:22,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:22,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:33:22,140 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a58d4c86d2df306cc460a231fd5a1ac1, disabling compactions & flushes 2018-05-02 06:33:22,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:22,160 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:22,161 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:22,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,165 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,165 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,166 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:33:22,166 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:33:22,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:33:22,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:33:22,166 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,166 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 1182d8ac9fbcff5334cd5fda2cf0c4a0, disabling compactions & flushes 2018-05-02 06:33:22,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:22,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 3f187e06c01ee258024c3bcea437345b, disabling compactions & flushes 2018-05-02 06:33:22,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:22,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,167 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:22,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:22,168 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 022c10bc256d7e8dc5d475d7ff8545ea, disabling compactions & flushes 2018-05-02 06:33:22,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:22,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:22,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13661.seqid, newMaxSeqId=13661, maxSeqId=13659 2018-05-02 06:33:22,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,212 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:22,212 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:22,212 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 5080f353428ccd74e13d5b5493533655, disabling compactions & flushes 2018-05-02 06:33:22,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:22,216 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,216 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,216 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,216 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:22,216 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:22,216 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,217 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing e56a9c7383092895c06ee33b9b84d892, disabling compactions & flushes 2018-05-02 06:33:22,217 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:22,217 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,217 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,217 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,217 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:22,218 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:22,218 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,218 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing f0e2ef89aaf5b6c921cae75dc420616f, disabling compactions & flushes 2018-05-02 06:33:22,218 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. 2018-05-02 06:33:22,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:22,249 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,250 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,250 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,250 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:22,250 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:22,250 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 89df5caac424c7424fede4183c6dce19, disabling compactions & flushes 2018-05-02 06:33:22,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:22,254 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/f0e2ef89aaf5b6c921cae75dc420616f/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:22,258 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1628.seqid, newMaxSeqId=1628, maxSeqId=1626 2018-05-02 06:33:22,260 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,260 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,260 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,260 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. 2018-05-02 06:33:22,261 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x06\xBC\xA1\xAF(k\xCA\x1A,1525241408832.f0e2ef89aaf5b6c921cae75dc420616f. 2018-05-02 06:33:22,261 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,261 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 670f6b815d2acac905130e5440d59304, disabling compactions & flushes 2018-05-02 06:33:22,261 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:33:22,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,262 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:22,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:22,263 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 84c55bda386b9aa62a8b4df75ca9b38c, disabling compactions & flushes 2018-05-02 06:33:22,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:33:22,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:22,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:22,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:22,283 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,283 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=8,queue=0,port=16020] ipc.RpcServer: callId: 8839 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:59580 deadline: 1525242892282, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:22,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 06:33:22,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:22,283 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=10,queue=0,port=16020] ipc.RpcServer: callId: 1379 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:34096 deadline: 1525242892282, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:22,284 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11895.seqid, newMaxSeqId=11895, maxSeqId=11893 2018-05-02 06:33:22,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,287 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:33:22,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:33:22,288 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,288 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 7b44edd79044515d04eb08298b1e52e9, disabling compactions & flushes 2018-05-02 06:33:22,288 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:22,298 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12213.seqid, newMaxSeqId=12213, maxSeqId=12211 2018-05-02 06:33:22,300 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/12004.seqid, newMaxSeqId=12004, maxSeqId=12002 2018-05-02 06:33:22,302 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,302 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,302 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,302 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:33:22,302 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:33:22,302 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 84e1f06e5813d24f1cc300fb32167710, disabling compactions & flushes 2018-05-02 06:33:22,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:33:22,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,305 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:22,305 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:22,305 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,305 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 19c6e3a27177cc57e6cf72ac907048ed, disabling compactions & flushes 2018-05-02 06:33:22,305 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:22,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:33:22,316 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,320 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,320 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,320 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:22,321 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:22,321 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,322 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 963add1708f89627737d4d216f3449df, disabling compactions & flushes 2018-05-02 06:33:22,322 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:33:22,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:22,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:22,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,389 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:22,390 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:22,390 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,391 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 4c37ee7a4e1210e481debdc2933fc4d2, disabling compactions & flushes 2018-05-02 06:33:22,391 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:33:22,430 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,431 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,431 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,431 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:33:22,431 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:33:22,432 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 26d4b78c3c7d2fdea4d32bb21a3ca5fe, disabling compactions & flushes 2018-05-02 06:33:22,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:33:22,450 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/963add1708f89627737d4d216f3449df/recovered.edits/12540.seqid, newMaxSeqId=12540, maxSeqId=12538 2018-05-02 06:33:22,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12256.seqid, newMaxSeqId=12256, maxSeqId=12254 2018-05-02 06:33:22,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,471 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:33:22,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,5c28f5bb,1525238855422.963add1708f89627737d4d216f3449df. 2018-05-02 06:33:22,472 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing e8edde5a00b30c080b02d1b096794b39, disabling compactions & flushes 2018-05-02 06:33:22,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:33:22,477 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,477 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,477 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,478 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:33:22,478 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:33:22,478 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,479 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing d5e9f3919d5e95ad2d6e01e1e16fa8ad, disabling compactions & flushes 2018-05-02 06:33:22,479 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:22,480 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12424.seqid, newMaxSeqId=12424, maxSeqId=12422 2018-05-02 06:33:22,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,487 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:33:22,487 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:33:22,487 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 98abf1ead3bf61c95cc4ffe5e6e5fe96, disabling compactions & flushes 2018-05-02 06:33:22,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:22,501 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:22,520 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,520 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,520 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,520 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:22,520 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:22,521 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,521 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:33:22,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing cdf5d5c10fe0b7d279387a401c3754ca, disabling compactions & flushes 2018-05-02 06:33:22,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:33:22,522 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:33:22,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 06:33:22,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:22,528 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:22,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,531 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:22,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:22,532 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,532 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 06:33:22,532 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:22,566 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13240.seqid, newMaxSeqId=13240, maxSeqId=13238 2018-05-02 06:33:22,570 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,572 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:22,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:22,572 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,573 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing c078deb2474e9c19b85b5fdb9efaa47d, disabling compactions & flushes 2018-05-02 06:33:22,573 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:22,573 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12089.seqid, newMaxSeqId=12089, maxSeqId=12087 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,576 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,576 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:33:22,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:22,576 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,576 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,577 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 5fc7cfd582bc270c530fe9787011078c, disabling compactions & flushes 2018-05-02 06:33:22,577 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:33:22,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 0fc1f394ae11e950c87a982abf7c1035, disabling compactions & flushes 2018-05-02 06:33:22,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:22,609 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,612 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:33:22,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:33:22,613 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 298977e880ecf479f4c50be95a5e8eb5, disabling compactions & flushes 2018-05-02 06:33:22,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:22,622 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:22,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11370.seqid, newMaxSeqId=11370, maxSeqId=11368 2018-05-02 06:33:22,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,629 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:22,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:22,630 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 24479666cac01319b99b1d0e11484b5c, disabling compactions & flushes 2018-05-02 06:33:22,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:33:22,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,633 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:22,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:22,633 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 411bd5dbc3845cf91c0d9f4649c84b86, disabling compactions & flushes 2018-05-02 06:33:22,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:22,639 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,650 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,650 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,650 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,650 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:22,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:22,651 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 06:33:22,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:33:22,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12606.seqid, newMaxSeqId=12606, maxSeqId=12604 2018-05-02 06:33:22,668 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,669 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,669 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,669 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,669 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:22,669 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:22,673 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing dc953453430fbf031584084fad7c31bd, disabling compactions & flushes 2018-05-02 06:33:22,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:33:22,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,687 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:33:22,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:33:22,688 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,689 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 93aea36f9251cfe49e28f84a517e3630, disabling compactions & flushes 2018-05-02 06:33:22,689 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:22,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12698.seqid, newMaxSeqId=12698, maxSeqId=12696 2018-05-02 06:33:22,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12797.seqid, newMaxSeqId=12797, maxSeqId=12795 2018-05-02 06:33:22,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:22,716 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,716 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,716 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,716 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:33:22,716 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:33:22,717 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,717 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 5c3fc4872d744c7bdc4c539ee55dc094, disabling compactions & flushes 2018-05-02 06:33:22,717 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:22,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,718 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:33:22,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:33:22,719 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a97e624ee736c77fbc6ccefb3abbac31, disabling compactions & flushes 2018-05-02 06:33:22,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:22,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,719 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:22,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:22,719 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,720 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 47377dfacc235cc247254a0eb8fe4f44, disabling compactions & flushes 2018-05-02 06:33:22,720 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:22,773 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:22,774 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12202.seqid, newMaxSeqId=12202, maxSeqId=12200 2018-05-02 06:33:22,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,776 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:22,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:22,777 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,777 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a0620fc83de532a37f6a9bb8f99cc6c4, disabling compactions & flushes 2018-05-02 06:33:22,778 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:22,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,786 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:22,786 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:22,786 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 06:33:22,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:33:22,791 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=10,queue=0,port=16020] ipc.RpcServer: callId: 8840 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:59580 deadline: 1525242892790, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:22,791 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=8,queue=0,port=16020] ipc.RpcServer: callId: 1380 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:34096 deadline: 1525242892790, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 aborting 2018-05-02 06:33:22,797 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:22,801 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,801 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,801 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,802 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:22,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:22,802 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 682775c01c8d957d744ae2b280c815cd, disabling compactions & flushes 2018-05-02 06:33:22,804 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:33:22,815 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12903.seqid, newMaxSeqId=12903, maxSeqId=12901 2018-05-02 06:33:22,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12476.seqid, newMaxSeqId=12476, maxSeqId=12474 2018-05-02 06:33:22,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,819 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:22,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:22,819 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 06:33:22,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:22,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,820 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:33:22,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:33:22,820 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing fa24e8d8fdd999d38faae5dbf847c334, disabling compactions & flushes 2018-05-02 06:33:22,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:22,865 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12513.seqid, newMaxSeqId=12513, maxSeqId=12511 2018-05-02 06:33:22,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,868 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:33:22,869 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:33:22,869 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 06:33:22,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:22,892 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Waiting on 24 regions to close 2018-05-02 06:33:22,908 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11541.seqid, newMaxSeqId=11541, maxSeqId=11539 2018-05-02 06:33:22,913 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,913 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,913 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,913 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:22,913 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:22,913 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,913 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 06:33:22,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:22,916 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:22,921 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,921 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,921 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,921 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:22,922 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:22,922 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,922 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 06:33:22,922 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:22,927 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/77.seqid, newMaxSeqId=77, maxSeqId=75 2018-05-02 06:33:22,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,930 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:22,931 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:22,931 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,931 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 06:33:22,931 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:22,970 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12812.seqid, newMaxSeqId=12812, maxSeqId=12810 2018-05-02 06:33:22,975 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:22,975 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:22,975 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:22,975 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:22,975 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:22,976 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:22,976 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 06:33:22,976 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:22,999 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/45.seqid, newMaxSeqId=45, maxSeqId=43 2018-05-02 06:33:23,003 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12773.seqid, newMaxSeqId=12773, maxSeqId=12771 2018-05-02 06:33:23,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,005 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:23,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:23,006 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing bb19a5bd59b1b3dff86020949234aaf5, disabling compactions & flushes 2018-05-02 06:33:23,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:33:23,007 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12731.seqid, newMaxSeqId=12731, maxSeqId=12729 2018-05-02 06:33:23,008 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,008 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,008 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,008 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:23,008 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:23,008 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,009 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 36261edb1d6e5ae1d91cf96e60680ebc, disabling compactions & flushes 2018-05-02 06:33:23,009 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:33:23,020 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,021 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,021 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,021 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:23,021 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:23,023 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,026 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 46af8f9145c39f07531ceaa92c7f8dbc, disabling compactions & flushes 2018-05-02 06:33:23,026 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:33:23,057 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:23,058 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=11 2018-05-02 06:33:23,061 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,061 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,061 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,061 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:33:23,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:33:23,062 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing e1d84fe7eb9adbf61fec50c75876bce8, disabling compactions & flushes 2018-05-02 06:33:23,063 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:23,066 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,067 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,067 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,067 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:33:23,067 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:33:23,067 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,068 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 8ac6e5d607af84df53c95bd38a03c313, disabling compactions & flushes 2018-05-02 06:33:23,068 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:33:23,083 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:23,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,087 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:33:23,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:33:23,088 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,088 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing a47cc34ca47759b3fd7bcaa79faebd3d, disabling compactions & flushes 2018-05-02 06:33:23,088 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:23,101 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:23,102 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:23,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,108 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:23,108 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:23,108 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,109 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing ab4e529620b9089675ab2d6f3446a39c, disabling compactions & flushes 2018-05-02 06:33:23,109 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:33:23,110 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,110 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,110 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,110 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:33:23,111 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:33:23,111 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,111 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 084aa7d8a3bd4d7483494d5a2c39d5df, disabling compactions & flushes 2018-05-02 06:33:23,111 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:33:23,143 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:23,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,148 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:23,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:23,149 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 530aabaf92e988eadd5338ed38b9be0c, disabling compactions & flushes 2018-05-02 06:33:23,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:33:23,172 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:23,175 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12610.seqid, newMaxSeqId=12610, maxSeqId=12608 2018-05-02 06:33:23,176 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,177 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:33:23,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:33:23,177 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,178 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,178 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,178 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,178 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:33:23,179 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:33:23,179 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,179 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 735c68afadbe039ceafe7e37c71a82b8, disabling compactions & flushes 2018-05-02 06:33:23,179 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:33:23,193 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:23,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 5bd8c2cd29520d0d27cacb48e7436a6d, disabling compactions & flushes 2018-05-02 06:33:23,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:23,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,199 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:33:23,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:33:23,200 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 1fa0746104343e63d4a6c982f8a3bf32, disabling compactions & flushes 2018-05-02 06:33:23,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:33:23,216 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:23,219 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,219 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,220 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,220 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:33:23,220 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:33:23,220 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,220 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing a8ff96226d546f0ea151823ae73e5a1b, disabling compactions & flushes 2018-05-02 06:33:23,220 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:33:23,242 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/12892.seqid, newMaxSeqId=12892, maxSeqId=12890 2018-05-02 06:33:23,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,247 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:23,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:23,247 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,248 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 3b0ff50ae790418c1d7b36d704a3c7a8, disabling compactions & flushes 2018-05-02 06:33:23,248 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:23,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:23,254 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,254 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,254 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,254 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:33:23,255 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:33:23,255 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,255 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closing 2e8da78a5421f95de8c75e0053e1d4a0, disabling compactions & flushes 2018-05-02 06:33:23,256 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:23,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11468.seqid, newMaxSeqId=11468, maxSeqId=11466 2018-05-02 06:33:23,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:23,273 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,273 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,273 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,276 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:23,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:23,276 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:33:23,276 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:33:23,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 06:33:23,277 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:23,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:33:23,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 06:33:23,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:23,278 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:23,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,283 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:23,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:23,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12809.seqid, newMaxSeqId=12809, maxSeqId=12807 2018-05-02 06:33:23,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,311 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:33:23,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 06:33:23,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13419.seqid, newMaxSeqId=13419, maxSeqId=13417 2018-05-02 06:33:23,316 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:23,316 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:23,316 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:23,316 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:23,316 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:23,494 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896; all regions closed. 2018-05-02 06:33:23,494 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:23,504 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:23,519 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:33:23,520 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 06:33:23,520 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:33:23,520 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:33:23,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 06:33:23,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:33:23,525 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:33:23,551 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896 2018-05-02 06:33:23,551 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900c3, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:33:23,552 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x3631f08b27900c3 closed 2018-05-02 06:33:23,552 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896; zookeeper connection closed. 2018-05-02 06:33:23,552 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:33:23,552 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting java.lang.RuntimeException: HRegionServer Aborted at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:67) at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149) at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2995) 2018-05-02 06:33:23,553 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. 2018-05-02 06:33:23,553 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down Wed May 2 06:34:52 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:34:55,655 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:34:55,657 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:34:55,657 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:34:55,657 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:34:55,657 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:34:56,285 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:34:56,285 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:34:56,285 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:34:56,285 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:34:56,286 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:34:56,286 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:34:56,286 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:34:56,286 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:34:56,287 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020634 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:34:56,288 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:34:56,289 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:34:56,290 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:34:56,291 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020634 2018-05-02 06:34:56,291 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:34:56,291 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:34:56,291 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:34:56,292 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:34:56,292 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:34:56,292 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:34:56,292 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:34:56,292 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:34:56,292 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:34:56,294 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:34:56,294 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020634, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:34:56,535 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:34:57,369 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:34:57,493 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:34:58,038 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:34:58,043 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:34:58,541 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:34:58,542 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:34:58,542 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:34:58,641 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:34:58,764 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:34:58,764 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:34:58,805 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:34:59,212 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 06:34:59,235 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:34:59,238 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:34:59,238 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:34:59,238 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:34:59,239 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:34:59,239 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:34:59,437 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:34:59,706 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:34:59,751 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:34:59,938 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 06:35:00,119 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:35:00,123 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:35:00,125 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:35:00,136 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:35:00,138 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:35:00,143 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:35:01,299 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:35:01,313 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:35:01,389 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:35:01,401 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:35:01,401 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:35:01,401 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:35:01,401 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:35:01,401 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:35:01,402 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:35:01,402 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:35:01,402 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:35:01,402 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:35:01,402 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:35:01,402 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:35:01,403 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:35:01,403 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:35:01,403 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:35:01,403 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:35:01,404 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:35:01,435 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:35:01,438 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:35:01,446 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:35:01,448 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:35:01 UTC 2018 2018-05-02 06:35:01,448 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:35:01 UTC 2018 2018-05-02 06:35:01,448 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:06:46 UTC 2018 2018-05-02 06:35:01,456 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:35:01,464 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:35:01,473 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c010e, negotiated timeout = 90000 2018-05-02 06:35:01,476 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:35:01,477 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e connected 2018-05-02 06:35:01,504 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:35:01,600 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:35:01,601 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:35:01,615 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:35:01,797 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:35:01,808 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:35:01,809 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:35:01,814 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:35:01,821 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:35:01,869 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:35:01,869 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:35:01,869 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:35:01,905 INFO [main] util.log: Logging initialized @7512ms 2018-05-02 06:35:02,041 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:35:02,066 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:35:02,067 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:35:02,072 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:35:02,072 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:35:02,072 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:35:02,118 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:35:02,120 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:35:02,188 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:35:02,188 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:35:02,422 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:35:02,429 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:35:02,447 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:35:02,447 INFO [main] server.Server: Started @8054ms 2018-05-02 06:35:02,492 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:35:02,499 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:35:02,527 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:35:02,527 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:35:02,553 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:35:02,663 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x0e73a7b1 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:35:02,738 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0e73a7b1] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$39/1062904901@7a583dca 2018-05-02 06:35:02,747 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0e73a7b1-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:35:02,750 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0e73a7b1-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:35:02,751 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0e73a7b1-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:35:02,757 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0e73a7b1-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900d0, negotiated timeout = 90000 2018-05-02 06:35:02,851 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@143c2bd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:35:02,855 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c6e1707, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:0 2018-05-02 06:35:02,864 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000008:16020 2018-05-02 06:35:02,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:35:02,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:35:02,913 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:35:02,913 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:35:02,913 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:35:02,913 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:35:02,913 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:35:02,913 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:35:02,913 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:35:02,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:35:02,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:35:02,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:35:02,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:35:02,914 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:35:03,170 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:35:03,174 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:35:03,181 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:35:03,181 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:35:03,186 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:35:03,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:35:03,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:35:03,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:35:03,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:35:03,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:35:03,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:35:03,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:35:03,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:35:03,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:35:03,247 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:35:03,247 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:35:03,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:35:03,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:35:03,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:35:03,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:35:03,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:35:03,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:35:03,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:35:03,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:35:03,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:35:03,272 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:35:03,272 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:35:03,272 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:35:03,272 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:35:03,327 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:35:03,371 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:35:03,371 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:35:03,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:35:03,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:35:03,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:35:03,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:35:03,374 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:35:03,381 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:35:03,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:35:03,383 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:35:03,383 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:35:03,383 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:35:03,383 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:35:03,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:35:03,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:35:03,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:35:03,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:35:03,386 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:35:03,386 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:35:03,387 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:35:03,387 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:35:03,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:35:03,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:35:03,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:35:03,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:35:03,389 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:35:03,393 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:35:03,397 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:35:03,405 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:35:03,753 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:35:04,125 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:35:07,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:35:07,564 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:35:07,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:35:07,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:35:07,566 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:35:07,566 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:35:07,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525242722107 with port=16020, startcode=1525242896337 2018-05-02 06:35:07,944 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:35:07,945 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:35:07,947 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:35:08,094 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:35:08,116 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:35:08,161 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:35:08,165 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:35:08,168 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:35:08,169 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:35:08,169 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:35:08,246 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:35:08,246 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:35:08,246 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:35:08,293 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:35:08,309 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:35:08,604 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:35:08,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:35:08,738 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:35:08,775 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:35:08,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:35:08,793 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:35:08,793 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:35:08,919 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:35:09,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:35:09,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:35:09,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:35:09,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:35:09,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:35:09,066 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:35:09,066 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:35:09,068 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:35:09,113 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 starting 2018-05-02 06:35:09,114 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:35:09,117 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:35:09,120 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:35:09,124 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:35:09,126 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:35:09,136 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683] other RSs: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683] 2018-05-02 06:35:09,166 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x1631f08b26c010e 2018-05-02 06:35:09,166 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:35:09,166 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:35:09,166 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337' 2018-05-02 06:35:09,166 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:35:09,167 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:35:09,168 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:35:09,168 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:35:09,168 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:35:09,168 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337' 2018-05-02 06:35:09,168 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:35:09,169 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:35:09,169 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:35:09,169 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:35:09,169 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:35:12,259 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242896337, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:35:12,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 266 ms, current pipeline: [] 2018-05-02 06:35:12,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242896337.1525242912259 2018-05-02 06:35:12,631 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:36:02,915 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0e73a7b1] zookeeper.ZooKeeper: Session: 0x3631f08b27900d0 closed 2018-05-02 06:36:02,924 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0e73a7b1-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:36:10,687 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963 2018-05-02 06:36:10,695 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963 znode expired, triggering replicatorRemoved event 2018-05-02 06:36:10,695 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:36:11,397 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:36:11,405 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 znode expired, triggering replicatorRemoved event 2018-05-02 06:36:11,405 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs Wed May 2 06:36:11 UTC 2018 Terminating regionserver 2018-05-02 06:36:11,521 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:36:11,521 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:36:11,521 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:36:11,521 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:36:11,521 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:36:11,521 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:36:11,521 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:36:11,521 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:11,521 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:36:11,521 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:36:11,522 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:36:11,522 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 06:36:11,522 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:36:11,522 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:36:11,529 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:36:11,529 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:36:11,529 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,529 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:36:11,529 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:36:11,530 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:11,530 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:36:11,530 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,530 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,530 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,530 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:36:11,530 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337' ***** 2018-05-02 06:36:11,531 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:11,531 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,531 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,531 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,531 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,531 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:11,558 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,582 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:11,585 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:36:11,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:36:11,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:36:11,588 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:36:11,588 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 exiting 2018-05-02 06:36:11,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:36:11,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:36:11,636 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:36:11,656 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:36:11,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:36:11,672 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:36:11,672 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:36:11,673 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:36:11,674 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:36:11,674 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:36:11,674 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:36:11,674 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x0e73a7b1 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:36:11,679 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:36:11,698 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337; all regions closed. 2018-05-02 06:36:11,700 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:36:11,811 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:36:11,811 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242896337:(num 1525242912259) 2018-05-02 06:36:11,811 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:36:11,812 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Leases: Closed leases 2018-05-02 06:36:11,812 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:36:11,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:36:11,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:36:11,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:36:11,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:36:11,814 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.NettyRpcServer: Stopping server on /172.27.69.22:16020 2018-05-02 06:36:11,814 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:36:11,814 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:36:11,863 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:36:11,863 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010e, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:36:11,867 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:36:11,867 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ZooKeeper: Session: 0x1631f08b26c010e closed 2018-05-02 06:36:11,867 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337; zookeeper connection closed. 2018-05-02 06:36:11,868 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:36:11,871 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:37:20 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000008.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:37:23,108 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:37:23,110 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:37:23,111 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:37:23,111 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:37:23,111 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:37:23,578 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:37:23,578 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:37:23,578 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:37:23,578 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:37:23,580 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:37:23,581 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020637 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=403071 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:37:23,582 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:37:23,583 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:37:23,583 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:37:23,583 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:37:23,583 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:37:23,583 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:37:23,583 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:37:23,584 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:37:23,585 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020637 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:37:23,586 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:37:23,590 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:37:23,590 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020637, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000008.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:37:23,887 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:37:24,430 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:37:24,488 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:37:25,165 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:37:25,173 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:37:25,748 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:37:25,748 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:37:25,748 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:37:25,816 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:37:25,972 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:37:25,972 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:37:26,005 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:37:26,532 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000008:16020 server-side Connection retries=105 2018-05-02 06:37:26,575 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:26,581 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:37:26,581 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:37:26,582 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:37:26,583 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:26,583 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:26,815 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:37:27,059 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:37:27,079 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:37:27,240 INFO [main] ipc.NettyRpcServer: Bind to /172.27.69.22:16020 2018-05-02 06:37:27,418 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:37:27,424 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:37:27,433 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:37:27,473 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:27,478 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:27,495 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:37:29,582 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:37:29,605 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:37:29,774 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:37:29,794 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:37:29,794 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:37:29,794 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:37:29,794 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:37:29,795 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:37:29,795 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:37:29,796 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:37:29,798 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:37:29,865 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:37:29,869 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:37:29,878 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:37:29,898 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:37:29,907 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:37:29 UTC 2018 2018-05-02 06:37:29,908 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:37:29 UTC 2018 2018-05-02 06:37:29,908 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:29:20 UTC 2018 2018-05-02 06:37:29,922 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:37:29,937 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d93900d0, negotiated timeout = 90000 2018-05-02 06:37:29,941 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:37:29,942 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0 connected 2018-05-02 06:37:29,982 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:37:30,102 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:37:30,102 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:37:30,102 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:37:30,103 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:37:30,113 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:30,181 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:30,187 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:37:30,188 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:37:30,209 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:30,231 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:30,326 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:37:30,326 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:37:30,326 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:37:30,514 INFO [main] util.log: Logging initialized @8742ms 2018-05-02 06:37:30,688 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:37:30,715 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:37:30,715 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:37:30,721 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:37:30,721 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:37:30,722 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:37:30,788 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:37:30,791 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:37:30,961 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:37:30,962 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:37:31,289 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:37:31,303 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000008.hwx.site,h=[ctr-e138-1518143905142-279227-01-000008.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:37:31,335 INFO [main] server.AbstractConnector: Started ServerConnector@74b10b58{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:37:31,335 INFO [main] server.Server: Started @9563ms 2018-05-02 06:37:31,395 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:37:31,403 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:37:31,433 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:37:31,433 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:37:31,442 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:37:31,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] zookeeper.ReadOnlyZKClient: Connect 0x3599de19 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:37:31,502 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3599de19] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/525585072@5a51473e 2018-05-02 06:37:31,506 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3599de19-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:37:31,508 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3599de19-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:37:31,508 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3599de19-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:37:31,512 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3599de19-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c0112, negotiated timeout = 90000 2018-05-02 06:37:31,605 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1075379f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:37:31,609 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b3c9312, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:0 2018-05-02 06:37:31,625 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000008:16020 2018-05-02 06:37:31,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:37:31,653 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:37:31,694 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:37:31,694 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:31,695 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:37:31,695 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:37:31,695 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:37:31,695 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:37:31,695 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:31,695 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:37:31,695 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:31,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:37:31,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:31,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:37:31,923 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:37:31,925 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:37:31,929 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:37:31,930 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:37:31,933 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:37:31,933 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:37:31,973 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:37:31,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:37:31,975 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:37:31,985 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:37:31,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:37:31,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:31,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:37:31,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:37:31,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:37:31,987 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:37:31,987 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:37:31,987 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:37:31,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:37:31,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:37:31,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:37:31,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:37:32,050 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:37:32,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:37:32,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:37:32,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:32,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:32,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:37:32,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:37:32,096 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:37:32,102 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:37:32,102 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:37:32,102 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:37:32,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:37:32,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:37:32,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:37:32,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:37:32,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:37:32,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:37:32,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:37:32,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:37:32,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:37:32,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:37:32,106 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:32,106 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:32,106 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:37:32,106 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:37:32,106 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:37:32,107 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:37:32,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:32,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:32,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:37:32,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:37:32,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:37:32,109 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:37:32,109 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:37:32,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:37:32,117 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:37:32,119 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:37:32,322 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:37:32,727 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:37:35,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:37:35,747 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:37:35,748 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:37:35,748 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:37:35,749 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:37:35,749 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:37:35,767 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525243032003 with port=16020, startcode=1525243043663 2018-05-02 06:37:35,889 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:37:35,890 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:35,891 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:37:36,004 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:36,030 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 736 from initSASLContext. 2018-05-02 06:37:36,037 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:37:36,038 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:37:36,056 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 107 for processing by initSASLContext 2018-05-02 06:37:36,058 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:37:36,060 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:37:36,061 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:37:36,061 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:37:36,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:37:36,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:37:36,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:37:36,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:37:36,165 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:36,426 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:37:36,461 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:37:36,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:37:36,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:37:36,528 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:37:36,553 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:37:36,948 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:37:36,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:37:36,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:37:36,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:37:36,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:37:36,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:37:36,950 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:37:36,953 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000008:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:37:37,016 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000008:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 starting 2018-05-02 06:37:37,018 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:37:37,024 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:37:37,031 WARN [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:37:37,035 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:37:37,038 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:37:37,068 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525243042691, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525243041096, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525243041096, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525243042691, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663] 2018-05-02 06:37:37,135 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663, RpcServer on ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:16020, sessionid=0x2631f08d93900d0 2018-05-02 06:37:37,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:37:37,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:37,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663' 2018-05-02 06:37:37,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:37:37,138 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:37:37,145 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:37:37,145 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:37:37,145 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:37,145 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663' 2018-05-02 06:37:37,145 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:37:37,147 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:37:37,148 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:37:37,148 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:37:37,149 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:37:40,223 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525243043663, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:37:40,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Slow sync cost: 338 ms, current pipeline: [] 2018-05-02 06:37:40,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525243043663.1525243060223 2018-05-02 06:37:40,672 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:37:41,714 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:37:56,720 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:37:56,725 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:37:56,725 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:56,735 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:37:56,746 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:56,747 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:37:56,749 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:56,750 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:56,750 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:37:56,903 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:37:56,919 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:37:57,021 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:37:57,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:37:57,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 5de3546305c82231844eb840c6cfa983, NAME => 'test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:37:57,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:37:57,129 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:37:57,156 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:37:57,157 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:37:57,160 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:37:57,160 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:37:57,174 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:37:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 06:37:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 06:37:57,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:37:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AuthenticationService 2018-05-02 06:37:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 06:37:57,176 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:37:57,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:37:57,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 06:37:57,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,261 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,262 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 06:37:57,262 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 06:37:57,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 06:37:57,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:37:57,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 06:37:57,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 06:37:57,268 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,268 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,268 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:37:57,268 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,268 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,268 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,268 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 06:37:57,269 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,269 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 06:37:57,269 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,273 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,268 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=SecureBulkLoadService 2018-05-02 06:37:57,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,273 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,273 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AccessControlService 2018-05-02 06:37:57,274 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,274 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,268 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,268 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,268 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 06:37:57,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 06:37:57,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 06:37:57,277 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 06:37:57,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:37:57,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:37:57,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:37:57,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5de3546305c82231844eb840c6cfa983 2018-05-02 06:37:57,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:37:57,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:37:57,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:37:57,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:37:57,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:37:57,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:37:57,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 06:37:57,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:37:57,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:37:57,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:37:57,338 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,340 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,340 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,340 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,340 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,340 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,456 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:37:57,456 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:37:57,456 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:37:57,456 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:37:57,456 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:37:57,457 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:37:57,457 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:37:57,457 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:37:57,459 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:37:57,459 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:37:57,468 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:37:57,468 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:37:57,474 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:37:57,474 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:37:57,513 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,514 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,514 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,515 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,517 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,518 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,519 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,532 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,532 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,532 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,532 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,533 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,533 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,534 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,614 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:37:57,655 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:37:57,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opening region: {ENCODED => 46af8f9145c39f07531ceaa92c7f8dbc, NAME => 'test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:37:57,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AuthenticationService 2018-05-02 06:37:57,657 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=SecureBulkLoadService 2018-05-02 06:37:57,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,657 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AccessControlService 2018-05-02 06:37:57,658 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,658 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,658 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:37:57,658 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:37:57,659 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,667 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:37:57,667 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opening region: {ENCODED => 530aabaf92e988eadd5338ed38b9be0c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:37:57,667 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:37:57,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AuthenticationService 2018-05-02 06:37:57,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opening region: {ENCODED => 93aea36f9251cfe49e28f84a517e3630, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:37:57,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AuthenticationService 2018-05-02 06:37:57,668 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:37:57,668 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=SecureBulkLoadService 2018-05-02 06:37:57,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opening region: {ENCODED => 41c625158570994727f1c92a8606ca6c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:37:57,668 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,669 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,669 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AccessControlService 2018-05-02 06:37:57,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AuthenticationService 2018-05-02 06:37:57,669 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=SecureBulkLoadService 2018-05-02 06:37:57,669 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,669 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,669 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AccessControlService 2018-05-02 06:37:57,670 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:37:57,670 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,670 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,670 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,670 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:37:57,670 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:37:57,671 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opening region: {ENCODED => bb19a5bd59b1b3dff86020949234aaf5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:37:57,671 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,671 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 41c625158570994727f1c92a8606ca6c 2018-05-02 06:37:57,671 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:37:57,671 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:37:57,671 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AuthenticationService 2018-05-02 06:37:57,671 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,672 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,672 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=SecureBulkLoadService 2018-05-02 06:37:57,672 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,672 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,672 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,672 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,672 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opening region: {ENCODED => f61045f3bb8866c33d9b05635d777d75, NAME => 'test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:37:57,672 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=SecureBulkLoadService 2018-05-02 06:37:57,672 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,672 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,672 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AccessControlService 2018-05-02 06:37:57,672 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,672 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AuthenticationService 2018-05-02 06:37:57,673 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,673 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,673 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AccessControlService 2018-05-02 06:37:57,673 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,673 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:37:57,673 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,673 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=SecureBulkLoadService 2018-05-02 06:37:57,673 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:37:57,673 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,673 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,673 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,673 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AccessControlService 2018-05-02 06:37:57,674 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,674 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:37:57,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:37:57,675 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,675 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,676 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:37:57,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:37:57,676 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,677 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opening region: {ENCODED => fa24e8d8fdd999d38faae5dbf847c334, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:37:57,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AuthenticationService 2018-05-02 06:37:57,678 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=SecureBulkLoadService 2018-05-02 06:37:57,678 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,678 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,678 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AccessControlService 2018-05-02 06:37:57,679 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,679 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,679 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:37:57,679 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:37:57,680 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,707 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:37:57,707 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:37:57,709 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,710 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,721 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 06:37:57,721 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 06:37:57,721 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:37:57,721 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 06:37:57,721 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 06:37:57,721 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 06:37:57,729 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1/a22fbfb1317a4c1493bae2cc0fc84cec 2018-05-02 06:37:57,739 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,739 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,739 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,739 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,739 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,749 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,749 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,770 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:37:57,770 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:37:57,774 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:37:57,774 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:37:57,774 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,776 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,776 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,777 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,779 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:37:57,779 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:37:57,780 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,781 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:37:57,781 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:37:57,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:37:57,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:37:57,786 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,787 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,787 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,788 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:37:57,788 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:37:57,789 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:37:57,789 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:37:57,790 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,790 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:37:57,791 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,791 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983 2018-05-02 06:37:57,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:37:57,798 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:37:57,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 06:37:57,917 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:37:57,971 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:37:57,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:37:57,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 06:37:57,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 06:37:57,975 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,975 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,975 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 06:37:57,976 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,976 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:37:57,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:37:57,977 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,981 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1/f817097956b04d90a34738b22c734e7a 2018-05-02 06:37:57,981 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,020 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1/295233e1f4a34156ae67883afcf73774 2018-05-02 06:37:58,020 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,033 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1/01824852ca574c54a2a33f4964ca59ec 2018-05-02 06:37:58,033 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,038 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:37:58,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opening region: {ENCODED => 2e8da78a5421f95de8c75e0053e1d4a0, NAME => 'test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:37:58,039 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1/76ab8edd7657482f8dbe68fd37422b11 2018-05-02 06:37:58,040 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AuthenticationService 2018-05-02 06:37:58,040 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=SecureBulkLoadService 2018-05-02 06:37:58,040 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,041 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AccessControlService 2018-05-02 06:37:58,041 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:37:58,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:37:58,043 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,044 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/7f6cc973fc9141ee84218d1cf4abc1f2 2018-05-02 06:37:58,054 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:37:58,056 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/2c6b0a92ce6e4b29b4f5e46b400fa68f 2018-05-02 06:37:58,057 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:37:58,057 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:37:58,058 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,060 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,066 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=48 2018-05-02 06:37:58,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13423.seqid, newMaxSeqId=13423, maxSeqId=13422 2018-05-02 06:37:58,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:37:58,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/12008.seqid, newMaxSeqId=12008, maxSeqId=12007 2018-05-02 06:37:58,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11472.seqid, newMaxSeqId=11472, maxSeqId=11471 2018-05-02 06:37:58,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13665.seqid, newMaxSeqId=13665, maxSeqId=13664 2018-05-02 06:37:58,069 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:37:58,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12252.seqid, newMaxSeqId=12252, maxSeqId=12251 2018-05-02 06:37:58,073 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:37:58,074 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c 2018-05-02 06:37:58,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:37:58,076 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=49 2018-05-02 06:37:58,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 06:37:58,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 06:37:58,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,078 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/335c9d0ca00f43be9b2be1bdaf09a958 2018-05-02 06:37:58,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 06:37:58,078 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,078 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:37:58,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:37:58,084 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] regionserver.HRegion: Opened 5de3546305c82231844eb840c6cfa983; next sequenceid=426 2018-05-02 06:37:58,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13423 2018-05-02 06:37:58,092 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13665 2018-05-02 06:37:58,092 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11472 2018-05-02 06:37:58,092 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=12008 2018-05-02 06:37:58,097 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=12252 2018-05-02 06:37:58,127 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:37:58,127 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:37:58,129 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,130 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,132 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/d5ac413ba8334de5a72f01d06da0f43f 2018-05-02 06:37:58,132 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,151 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:37:58,163 INFO [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:37:58,163 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:37:58,163 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:37:58,164 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:37:58,164 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:37:58,164 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:37:58,183 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:37:58,184 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:37:58,184 DEBUG [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:37:58,184 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:37:58,185 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:37:58,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,185 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:37:58,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,186 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:37:58,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,429 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:37:58,473 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:37:58,476 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/649450abe53e433192b35544d0e0ab96 2018-05-02 06:37:58,477 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,478 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/8cbf0c74e0754545a377c74c6bcdb70f 2018-05-02 06:37:58,478 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,480 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:37:58,480 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:37:58,483 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,492 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,501 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 06:37:58,501 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,501 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:37:58,501 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:37:58,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:37:58,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:37:58,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:37:58,504 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:37:58,510 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] regionserver.HRegion: Opened bb19a5bd59b1b3dff86020949234aaf5; next sequenceid=420 2018-05-02 06:37:58,512 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1/4a57c45b7e83443f9ac51c1f0ee9e848 2018-05-02 06:37:58,512 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,516 INFO [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:37:58,518 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] regionserver.HRegion: Opened 46af8f9145c39f07531ceaa92c7f8dbc; next sequenceid=426 2018-05-02 06:37:58,526 DEBUG [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:37:58,527 INFO [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:37:58,527 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,528 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] regionserver.HRegion: Opened 41c625158570994727f1c92a8606ca6c; next sequenceid=423 2018-05-02 06:37:58,531 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] regionserver.HRegion: Opened fa24e8d8fdd999d38faae5dbf847c334; next sequenceid=420 2018-05-02 06:37:58,531 DEBUG [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:37:58,531 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,534 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:37:58,544 INFO [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:37:58,544 INFO [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:37:58,549 DEBUG [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:37:58,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,551 DEBUG [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:37:58,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:37:58,552 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:37:58,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:37:58,571 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opening region: {ENCODED => 54c783f1faee76bcce84aee6145e82d1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:37:58,572 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AuthenticationService 2018-05-02 06:37:58,572 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,572 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=SecureBulkLoadService 2018-05-02 06:37:58,572 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,572 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,572 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,573 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AccessControlService 2018-05-02 06:37:58,573 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,573 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,573 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:37:58,573 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:37:58,574 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,579 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] regionserver.HRegion: Opened f61045f3bb8866c33d9b05635d777d75; next sequenceid=429 2018-05-02 06:37:58,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:37:58,584 INFO [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:37:58,589 DEBUG [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:37:58,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,595 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 06:37:58,595 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,604 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:37:58,620 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] regionserver.HRegion: Opened 530aabaf92e988eadd5338ed38b9be0c; next sequenceid=420 2018-05-02 06:37:58,623 INFO [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:37:58,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:37:58,628 DEBUG [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:37:58,628 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,631 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:37:58,631 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:37:58,632 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] regionserver.HRegion: Opened 93aea36f9251cfe49e28f84a517e3630; next sequenceid=429 2018-05-02 06:37:58,632 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,633 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12801.seqid, newMaxSeqId=12801, maxSeqId=12800 2018-05-02 06:37:58,636 INFO [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:37:58,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:37:58,655 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12801 2018-05-02 06:37:58,658 DEBUG [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:37:58,658 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,659 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:37:58,663 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:37:58,664 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] regionserver.HRegion: Opened 2e8da78a5421f95de8c75e0053e1d4a0; next sequenceid=429 2018-05-02 06:37:58,664 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,667 INFO [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:37:58,672 DEBUG [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:37:58,672 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,681 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/821797aa04f34c5ba99842ed2104658a 2018-05-02 06:37:58,684 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12555.seqid, newMaxSeqId=12555, maxSeqId=12554 2018-05-02 06:37:58,697 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12555 2018-05-02 06:37:58,700 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:37:58,704 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:37:58,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,709 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/accb28f8bfa44c80a458ea61bfad3c0c 2018-05-02 06:37:58,709 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:37:58,747 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:37:58,755 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] regionserver.HRegion: Opened 54c783f1faee76bcce84aee6145e82d1; next sequenceid=426 2018-05-02 06:37:58,758 INFO [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:37:58,762 DEBUG [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:37:58,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:37:58,966 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:37:58,989 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opening region: {ENCODED => d5e9f3919d5e95ad2d6e01e1e16fa8ad, NAME => 'test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:37:58,989 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AuthenticationService 2018-05-02 06:37:58,989 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=SecureBulkLoadService 2018-05-02 06:37:58,990 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,990 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,990 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AccessControlService 2018-05-02 06:37:58,990 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:37:58,992 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:37:58,992 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:58,995 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:37:58,999 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:59,000 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:59,000 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:59,000 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:37:59,001 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:37:59,001 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:37:59,002 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:59,002 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:59,002 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:59,002 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:37:59,033 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:37:59,034 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:37:59,035 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:59,036 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:59,108 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1/b7efbef765ea477fa322e685336bf3fd 2018-05-02 06:37:59,108 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:59,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:37:59,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:37:59,226 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] regionserver.HRegion: Opened d5e9f3919d5e95ad2d6e01e1e16fa8ad; next sequenceid=426 2018-05-02 06:37:59,236 INFO [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:37:59,242 DEBUG [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:37:59,242 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000008:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. on ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:38:00,518 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,519 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,519 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,519 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,519 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:02,311 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:38:02,313 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:38:02,315 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:38:02,821 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:38:03,103 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:38:03,104 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:38:03,195 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:38:03,195 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:38:03,195 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:38:03,203 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:38:03,206 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:38:03,206 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:38:05,155 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@7e505a95 2018-05-02 06:38:05,157 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:38:05,158 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:38:05,158 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:38:05,161 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900d5, negotiated timeout = 10000 2018-05-02 06:38:05,194 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:38:05,202 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:38:05,991 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:38:05,991 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:38:05,992 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:38:05,992 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:38:05,993 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:38:05,993 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:38:31,538 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3599de19] zookeeper.ZooKeeper: Session: 0x1631f08b26c0112 closed 2018-05-02 06:38:31,539 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3599de19-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:38:32,123 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.029 minutes, events=8, succcessCount=4, totalEvents=8, totalSuccessCount=4 2018-05-02 06:38:47,028 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:38:47,416 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:38:47,422 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:38:50,033 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:38:53,038 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:38:53,038 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:38:53,038 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:38:53,041 DEBUG [RS-EventLoopGroup-1-7] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:38:53,048 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:38:53,068 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:38:53,070 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:38:53,072 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:38:53,072 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:38:53,073 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:39:25,107 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000008.hwx.site@EXAMPLE.COM 2018-05-02 06:39:25,110 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:39:25,110 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:25,116 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:39:25,118 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:25,119 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:39:25,120 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:25,120 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:39:25,121 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:40:12,002 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,003 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:40:12,005 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,006 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,008 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663 2018-05-02 06:40:12,009 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 14 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:40:12,023 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:40:12,026 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:40:12,026 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:40:12,026 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d93900d0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/13 2018-05-02 06:40:12,027 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:42:27,464 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=155.91 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=2, accesses=10, hits=8, hitRatio=80.00%, , cachingAccesses=10, cachingHits=8, cachingHitsRatio=80.00%, evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 06:42:37,038 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:42:37,039 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000008:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:43:02,310 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:43:02,312 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:43:02,314 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:43:02,823 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:43:03,049 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:43:03,049 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000008.hwx.site, serviceName = hbase 2018-05-02 06:43:03,114 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000008.hwx.site 2018-05-02 06:43:03,114 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:43:03,115 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:43:03,119 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:43:03,121 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:43:03,121 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started